Jul 24 12:32:43 devstack cinder-volume[77354]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 12:32:43 devstack cinder-volume[77354]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 12:32:43 devstack cinder-volume[77354]: we strongly recommend against using it for new projects. Jul 24 12:32:43 devstack cinder-volume[77354]: If you are already using Eventlet, we recommend migrating to a different Jul 24 12:32:43 devstack cinder-volume[77354]: framework. For more detail see Jul 24 12:32:43 devstack cinder-volume[77354]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 12:32:43 devstack cinder-volume[77354]: import eventlet # noqa Jul 24 12:32:46 devstack cinder-volume[77354]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77354) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 12:32:46 devstack cinder-volume[77354]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77354) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 12:32:46 devstack cinder-volume[77354]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77354) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 12:32:47 devstack cinder-volume[77354]: INFO dbcounter [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Registered counter for database cinder Jul 24 12:32:47 devstack cinder-volume[77354]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77354) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:32:48 devstack cinder-volume[77354]: DEBUG dbcounter [-] [77354] Writer thread running {{(pid=77354) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 12:32:48 devstack cinder-volume[77354]: INFO cinder.rpc [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 12:32:48 devstack cinder-volume[77354]: INFO cinder.rpc [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 12:32:48 devstack cinder-volume[77354]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77354) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:32:48 devstack cinder-volume[77354]: INFO cinder.volume.manager [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Determined volume DB was empty at startup. Jul 24 12:32:48 devstack cinder-volume[77354]: DEBUG cinder.volume.manager [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77354) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 12:32:48 devstack cinder-volume[77354]: INFO cinder.volume.manager [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 24 12:32:48 devstack cinder-volume[77354]: WARNING stevedore.named [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 12:32:48 devstack cinder-volume[77354]: WARNING castellan.key_manager [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 12:32:48 devstack cinder-volume[77354]: WARNING cinder.keymgr.conf_key_mgr [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 12:32:48 devstack cinder-volume[77354]: DEBUG cinder.volume.drivers.lvm [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77354) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 24 12:32:48 devstack cinder-volume[77354]: DEBUG oslo_concurrency.processutils [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77354) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:48 devstack cinder-volume[77354]: DEBUG oslo_concurrency.processutils [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.443s {{(pid=77354) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:48 devstack cinder-volume[77354]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77354) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:32:48 devstack cinder-volume[77354]: INFO cinder.rpc [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 24 12:32:48 devstack cinder-volume[77354]: INFO cinder.rpc [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 24 12:32:48 devstack cinder-volume[77354]: WARNING stevedore.named [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 12:32:48 devstack cinder-volume[77354]: WARNING castellan.key_manager [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 12:32:48 devstack cinder-volume[77354]: INFO cinder.volume.manager [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_db.sqlalchemy.engines [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77354) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:32:49 devstack cinder-volume[77354]: INFO oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Starting 1 workers Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Started child 77561 {{(pid=77354) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Full set of CONF: {{(pid=77354) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] ******************************************************************************** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Configuration options gathered from: {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] ================================================================================ {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] allow_availability_zone_fallback = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] allow_compression_on_image_upload = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] allowed_direct_url_schemes = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] api_rate_limit = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] auth_strategy = keystone {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] az_cache_duration = 3600 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_availability_zone = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_host = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_stats_polling_interval = 60 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backup_api_class = cinder.backup.api.API {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77561]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backup_name_template = backup-%s {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backup_use_same_host = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backup_use_temp_snapshot = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] chap_password = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] chap_username = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cinder_internal_tenant_project_id = db73dd98ac574b52ad6eef50d8f193ed {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cinder_internal_tenant_user_id = 9085e80a91d043538ce301e4337ddd66 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cloned_volume_same_az = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cluster = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] compression_format = gzip {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] compute_api_class = cinder.compute.nova.API {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] config_dir = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] config_source = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] control_exchange = openstack {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] debug = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] default_availability_zone = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] default_group_type = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] default_volume_type = lvmdriver-1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] disk_geometry = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] driver_client_cert = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] driver_client_cert_key = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] driver_data_namespace = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] driver_ssl_cert_path = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] driver_ssl_cert_verify = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] driver_use_ssl = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] enable_force_upload = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] enable_new_services = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] enable_unsupported_driver = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] enforce_multipath_for_image_xfer = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] filter_function = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_api_insecure = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_api_servers = ['http://192.168.122.192/image'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_api_ssl_compression = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_ca_certificates_file = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_catalog_info = image:glance:publicURL {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_certfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_keyfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_num_retries = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance_request_timeout = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] goodness_function = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] graceful_shutdown_timeout = 5 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] group_api_class = cinder.group.api.API {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] host = devstack {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_compress_on_upload = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_conversion_address_space_limit = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_conversion_cpu_limit = 60 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_conversion_disable = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_upload_use_cinder_backend = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_upload_use_internal_tenant = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_volume_cache_enabled = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_volume_cache_max_count = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] image_volume_cache_max_size_gb = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] init_host_max_objects_retrieval = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] instance_format = [instance: %(uuid)s] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] iscsi_target_flags = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77561]: INFO cinder.volume.manager [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] iscsi_write_cache = on {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] iser_helper = tgtadm {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] iser_ip_address = 192.168.122.192 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] iser_port = 3260 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] log_color = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] log_config_append = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] log_dir = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] log_file = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] log_options = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] log_rotate_interval = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] log_rotate_interval_type = days {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] log_rotation_type = none {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] max_age = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] max_logfile_count = 30 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] max_logfile_size_mb = 200 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] max_over_subscription_ratio = 20.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] message_reap_interval = 86400 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] message_ttl = 2592000 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] migration_create_volume_timeout_secs = 300 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] monkey_patch = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] monkey_patch_modules = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] my_ip = 192.168.122.192 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] no_snapshot_gb_quota = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] num_iser_scan_tries = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] num_shell_tries = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] num_volume_device_scan_tries = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] nvmeof_conn_info_version = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] nvmet_ns_id = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] nvmet_port_id = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] osapi_max_limit = 1000 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] osapi_volume_ext_list = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] osapi_volume_listen_port = 8776 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] osapi_volume_use_ssl = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] osapi_volume_workers = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] per_volume_size_limit = -1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] periodic_fuzzy_delay = 60 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] periodic_interval = 60 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] public_endpoint = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] publish_errors = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] quota_backup_gigabytes = 1000 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] quota_backups = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] quota_gigabytes = 1000 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] quota_groups = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] quota_snapshots = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] quota_volumes = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] rate_limit_burst = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] rate_limit_except_level = CRITICAL {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] rate_limit_interval = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] reinit_driver_count = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] replication_device = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] report_discard_supported = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] report_interval = 120 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] reservation_clean_interval = 86400 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] reservation_expire = 86400 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] reserved_image_namespaces = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] reserved_percentage = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] rpc_response_timeout = 120 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] run_external_periodic_tasks = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] scst_target_driver = iscsi {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] scst_target_iqn_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_down_time = 720 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] shell_completion = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] snapshot_name_template = snapshot-%s {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] snapshot_same_host = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] split_loggers = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] state_path = /opt/stack/data/cinder {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] storage_availability_zone = nova {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] storage_protocol = iSCSI {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] syslog_log_facility = LOG_USER {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] target_helper = lioadm {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] target_ip_address = 192.168.122.192 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] target_port = 3260 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] target_protocol = iscsi {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] target_secondary_ip_addresses = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] trace_flags = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] transport_url = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] until_refresh = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] use_chap_auth = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] use_default_quota_class = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] use_journal = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] use_json = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] use_multipath_for_image_xfer = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] use_stderr = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] use_syslog = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] verify_glance_signatures = enabled {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_api_class = cinder.volume.api.API {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_backend_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_clear = zero {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_clear_ionice = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_clear_size = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_copy_bps_limit = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_dd_blocksize = 1M {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_name_template = volume-%s {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_service_inithost_offload = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volume_usage_audit_period = month {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] zoning_mode = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_concurrency.disable_process_locking = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.auth_section = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.auth_type = password {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.auth_version = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.cache = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.certfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.include_service_catalog = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.insecure = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.interface = public {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.keyfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_password = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcache_username = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.region_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.service_type = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.backend = dogpile.cache.null {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.backend_argument = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.backend_expiration_time = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.config_prefix = cache.oslo {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.debug_cache_backend = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.enable_retry_client = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.enable_socket_keepalive = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.enabled = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.expiration_time = 600 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.hashclient_retry_attempts = 2 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.memcache_dead_retry = 300 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.memcache_pool_maxsize = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.memcache_sasl_enabled = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.password = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.proxies = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.redis_db = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.redis_server = localhost:6379 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.retry_attempts = 2 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.retry_delay = 0.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.socket_keepalive_count = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.socket_keepalive_idle = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.socket_keepalive_interval = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.socket_timeout = 1.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.tls_allowed_ciphers = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.tls_cafile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.tls_certfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.tls_enabled = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.tls_keyfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cache.username = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] coordination.backend_url = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.asyncio_connection = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.asyncio_slave_connection = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.backend = sqlalchemy {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.connection = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.connection_debug = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.connection_parameters = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.connection_recycle_time = 3600 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.connection_trace = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.db_inc_retry_interval = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.db_max_retries = 20 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.db_max_retry_interval = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.db_retry_interval = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.max_overflow = 50 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.max_pool_size = 5 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.max_retries = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.mysql_wsrep_sync_wait = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.pool_timeout = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.retry_interval = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.slave_connection = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.sqlite_synchronous = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.synchronous_reader = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] database.use_db_reconnect = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.connection_string = messaging:// {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.enabled = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.es_doc_type = notification {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.es_scroll_size = 10000 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.es_scroll_time = 2m {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.filter_error_trace = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.hmac_keys = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.sentinel_service_name = mymaster {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.socket_timeout = 0.1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.trace_requests = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler.trace_sqlalchemy = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler_jaeger.process_tags = {} {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler_jaeger.service_name_prefix = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] profiler_otlp.service_name_prefix = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.enforce_new_defaults = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.policy_default_rule = default {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.policy_file = policy.yaml {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack sudo[77607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 24 12:32:49 devstack sudo[77607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] privsep_osbrick.group = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] privsep_osbrick.helper_command = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] privsep_osbrick.user = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cinder_sys_admin.group = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cinder_sys_admin.helper_command = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] cinder_sys_admin.user = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.auth_section = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.auth_type = password {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.cafile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.certfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.collect_timing = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.insecure = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.keyfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.send_service_user_token = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.split_loggers = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] service_user.timeout = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.auth_section = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.auth_type = password {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.certfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.collect_timing = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.insecure = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.keyfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.region_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.split_loggers = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] glance.timeout = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.backend_availability_zone = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.chap_password = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.chap_username = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.disk_geometry = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.driver_client_cert = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.driver_client_cert_key = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.driver_data_namespace = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.driver_use_ssl = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.extra_capabilities = {} {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.filter_function = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.goodness_function = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.iscsi_target_flags = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.iscsi_write_cache = on {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.iser_helper = tgtadm {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.iser_port = 3260 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.lvm_share_target = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.lvm_type = auto {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.num_shell_tries = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.replication_device = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.report_discard_supported = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.reserved_percentage = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.target_helper = tgtadm {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.target_port = 3260 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.target_protocol = iscsi {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.trace_flags = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.unique_fqdn_network = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.use_chap_auth = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volume_backend_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volume_clear = zero {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volume_clear_ionice = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volume_clear_size = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_reports.file_event_handler = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_reports.log_dir = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.backend_host = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.chap_password = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.chap_username = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.disk_geometry = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.driver_client_cert = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.extra_capabilities = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.filter_function = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.goodness_function = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.iser_helper = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.iser_ip_address = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.iser_port = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.lvm_share_target = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.lvm_type = auto {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.num_shell_tries = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.replication_device = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.report_discard_supported = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.reserved_percentage = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.scst_target_driver = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.storage_protocol = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.target_helper = lioadm {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.target_ip_address = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.target_port = 3260 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.trace_flags = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.use_chap_auth = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volume_clear = zero {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volume_clear_size = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] lvmdriver-1.volumes_dir = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.ssl = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_notifications.driver = [] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_notifications.retry = -1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] key_manager.fixed_key = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.barbican_api_version = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.barbican_endpoint = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.barbican_endpoint_type = public {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.barbican_region_name = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.cafile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.certfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.collect_timing = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.insecure = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.keyfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.number_of_retries = 60 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.retry_delay = 1 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.send_service_user_token = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.split_loggers = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.timeout = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.verify_ssl = True {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican.verify_ssl_path = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican_service_user.auth_section = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican_service_user.auth_type = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican_service_user.cafile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican_service_user.certfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican_service_user.collect_timing = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican_service_user.insecure = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican_service_user.keyfile = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican_service_user.split_loggers = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] barbican_service_user.timeout = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.approle_role_id = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.approle_secret_id = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.auth_method = approle {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.auth_path = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.kv_mountpoint = secret {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.kv_path = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.kv_version = 2 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.namespace = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.root_token_id = **** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.ssl_ca_crt_file = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.timeout = 60.0 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.token_file = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.token_role = None {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.use_ssl = False {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:32:49 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] ******************************************************************************** {{(pid=77354) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 12:32:49 devstack sudo[77607]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:49 devstack sudo[77691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:32:49 devstack sudo[77691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:49 devstack sudo[77691]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.270s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:32:49 devstack cinder-volume[77561]: INFO cinder.brick.local_dev.lvm [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:49 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:49 devstack sudo[77776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:32:49 devstack sudo[77776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:50 devstack sudo[77776]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG cinder.brick.local_dev.lvm [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77561) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:50 devstack sudo[77859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:32:50 devstack sudo[77859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:50 devstack sudo[77859]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.522s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:50 devstack sudo[78037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:32:50 devstack sudo[78037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:50 devstack sudo[78037]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.328s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:50 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:50 devstack sudo[78107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 24 12:32:50 devstack sudo[78107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:51 devstack sudo[78107]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:51 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.261s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:51 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:51 devstack sudo[78134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:32:51 devstack sudo[78134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:51 devstack sudo[78134]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:51 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:51 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:51 devstack sudo[78193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:32:51 devstack sudo[78193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:51 devstack sudo[78193]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:51 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:51 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:51 devstack sudo[78202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:32:51 devstack sudo[78202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:52 devstack sudo[78202]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:52 devstack sudo[78285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:32:52 devstack sudo[78285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:52 devstack sudo[78285]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:52 devstack sudo[78289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:32:52 devstack sudo[78289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:52 devstack sudo[78289]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:52 devstack cinder-volume[77561]: INFO cinder.volume.drivers.lvm [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:52 devstack sudo[78299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:32:52 devstack sudo[78299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:52 devstack sudo[78299]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG cinder.volume.drivers.lvm [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Updating volume stats {{(pid=77561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 12:32:52 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:52 devstack sudo[78302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:32:52 devstack sudo[78302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:53 devstack sudo[78302]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:53 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:53 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:53 devstack sudo[78305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:32:53 devstack sudo[78305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:53 devstack sudo[78305]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:53 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:53 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:53 devstack sudo[78309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:32:53 devstack sudo[78309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:53 devstack sudo[78309]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:53 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:53 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:53 devstack sudo[78312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:32:53 devstack sudo[78312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:54 devstack sudo[78312]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:54 devstack cinder-volume[77561]: INFO cinder.volume.driver [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG cinder.volume.driver [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77561) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG oslo_db.sqlalchemy.engines [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77561) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG dbcounter [-] [77561] Writer thread running {{(pid=77561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG cinder.db.api [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Building query based on filter {{(pid=77561) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG cinder.image.image_utils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77561) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 12:32:54 devstack cinder-volume[77561]: INFO cinder.keymgr.migration [None req-7b616cf2-bc1d-4ed2-a9a1-8ec9abf222c0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG cinder.volume.drivers.lvm [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Updating volume stats {{(pid=77561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:54 devstack sudo[78317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:32:54 devstack sudo[78317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:54 devstack sudo[78317]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:54 devstack sudo[78320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:32:54 devstack sudo[78320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:54 devstack sudo[78320]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:54 devstack sudo[78323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:32:54 devstack sudo[78323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:54 devstack sudo[78323]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:54 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:54 devstack sudo[78327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:32:54 devstack sudo[78327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:55 devstack sudo[78327]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG cinder.manager [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Notifying Schedulers of capabilities ... {{(pid=77561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:32:55 devstack cinder-volume[77561]: INFO cinder.volume.manager [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Driver initialization completed successfully. Jul 24 12:32:55 devstack cinder-volume[77561]: INFO cinder.manager [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Initiating service 2 cleanup Jul 24 12:32:55 devstack cinder-volume[77561]: INFO cinder.manager [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Service 2 cleanup completed. Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG cinder.service [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Creating RPC server for service cinder-volume {{(pid=77561) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG cinder.service [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77561) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 12:32:55 devstack cinder-volume[77561]: INFO cinder.volume.manager [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG cinder.volume.drivers.lvm [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Updating volume stats {{(pid=77561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:55 devstack sudo[78331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:32:55 devstack sudo[78331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:55 devstack sudo[78331]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:55 devstack sudo[78334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:32:55 devstack sudo[78334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:55 devstack sudo[78334]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:55 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:55 devstack sudo[78337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:32:55 devstack sudo[78337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:56 devstack sudo[78337]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:56 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:56 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:32:56 devstack sudo[78343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:32:56 devstack sudo[78343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:32:56 devstack sudo[78343]: pam_unix(sudo:session): session closed for user root Jul 24 12:32:56 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:32:56 devstack cinder-volume[77561]: INFO cinder.volume.manager [None req-a076095e-5885-4a01-9b51-edb89d7a2c57 None None] Driver post RPC initialization completed successfully. Jul 24 12:32:59 devstack cinder-volume[77354]: DEBUG dbcounter [-] [77354] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77354) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:33:05 devstack cinder-volume[77561]: DEBUG dbcounter [-] [77561] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:33:06 devstack cinder-volume[77561]: DEBUG dbcounter [-] [77561] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:33:23 devstack cinder-volume[77561]: DEBUG oslo_service.periodic_task [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running periodic task VolumeManager._thread_info {{(pid=77561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:33:23 devstack cinder-volume[77561]: DEBUG cinder.volume.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] thread count: 6 {{(pid=77561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:33:23 devstack cinder-volume[77561]: DEBUG cinder.volume.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] thread info: [<_MainThread(MainThread, started 133964690587776)>, , , , , ] {{(pid=77561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:34:23 devstack cinder-volume[77561]: DEBUG oslo_service.periodic_task [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:34:23 devstack cinder-volume[77561]: DEBUG cinder.volume.drivers.lvm [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Updating volume stats {{(pid=77561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 12:34:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:34:23 devstack sudo[80985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:34:23 devstack sudo[80985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:34:23 devstack sudo[80985]: pam_unix(sudo:session): session closed for user root Jul 24 12:34:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:34:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:34:23 devstack sudo[80988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:34:23 devstack sudo[80988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:34:24 devstack sudo[80988]: pam_unix(sudo:session): session closed for user root Jul 24 12:34:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:34:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:34:24 devstack sudo[80991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:34:24 devstack sudo[80991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:34:24 devstack sudo[80991]: pam_unix(sudo:session): session closed for user root Jul 24 12:34:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:34:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:34:24 devstack sudo[80994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:34:24 devstack sudo[80994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:34:24 devstack sudo[80994]: pam_unix(sudo:session): session closed for user root Jul 24 12:34:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:34:24 devstack cinder-volume[77561]: DEBUG cinder.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Notifying Schedulers of capabilities ... {{(pid=77561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:34:24 devstack cinder-volume[77561]: DEBUG oslo_service.periodic_task [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running periodic task VolumeManager._thread_info {{(pid=77561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:34:24 devstack cinder-volume[77561]: DEBUG cinder.volume.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] thread count: 6 {{(pid=77561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:34:24 devstack cinder-volume[77561]: DEBUG cinder.volume.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] thread info: [<_MainThread(MainThread, started 133964690587776)>, , , , , ] {{(pid=77561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:35:06 devstack cinder-volume[77561]: DEBUG dbcounter [-] [77561] Writing DB stats cinder:SELECT=1 {{(pid=77561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:35:06 devstack cinder-volume[77561]: DEBUG dbcounter [-] [77561] Writing DB stats cinder:UPDATE=1 {{(pid=77561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:35:23 devstack cinder-volume[77561]: DEBUG oslo_service.periodic_task [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:35:23 devstack cinder-volume[77561]: DEBUG cinder.volume.drivers.lvm [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Updating volume stats {{(pid=77561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 12:35:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:35:23 devstack sudo[84620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:35:23 devstack sudo[84620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:35:23 devstack sudo[84620]: pam_unix(sudo:session): session closed for user root Jul 24 12:35:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:35:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:35:23 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:35:23 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:35:24 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Jul 24 12:35:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:35:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:35:24 devstack sudo[84626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:35:24 devstack sudo[84626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:35:24 devstack sudo[84626]: pam_unix(sudo:session): session closed for user root Jul 24 12:35:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:35:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:35:24 devstack sudo[84655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:35:24 devstack sudo[84655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:35:24 devstack sudo[84655]: pam_unix(sudo:session): session closed for user root Jul 24 12:35:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:35:24 devstack cinder-volume[77561]: DEBUG cinder.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Notifying Schedulers of capabilities ... {{(pid=77561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:35:24 devstack cinder-volume[77561]: DEBUG oslo_service.periodic_task [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running periodic task VolumeManager._thread_info {{(pid=77561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:35:24 devstack cinder-volume[77561]: DEBUG cinder.volume.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] thread count: 6 {{(pid=77561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:35:24 devstack cinder-volume[77561]: DEBUG cinder.volume.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] thread info: [<_MainThread(MainThread, started 133964690587776)>, , , , , ] {{(pid=77561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:36:23 devstack cinder-volume[77561]: DEBUG oslo_service.periodic_task [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:36:23 devstack cinder-volume[77561]: DEBUG cinder.volume.drivers.lvm [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Updating volume stats {{(pid=77561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 12:36:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:36:23 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:36:23 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:36:23 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Jul 24 12:36:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:36:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:36:23 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:36:23 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:36:24 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Jul 24 12:36:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:36:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:36:24 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:36:24 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:36:24 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Jul 24 12:36:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:36:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:36:24 devstack sudo[86345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:36:24 devstack sudo[86345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:36:24 devstack sudo[86345]: pam_unix(sudo:session): session closed for user root Jul 24 12:36:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:36:24 devstack cinder-volume[77561]: DEBUG cinder.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Notifying Schedulers of capabilities ... {{(pid=77561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:37:06 devstack cinder-volume[77561]: DEBUG dbcounter [-] [77561] Writing DB stats cinder:SELECT=1 {{(pid=77561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:37:06 devstack cinder-volume[77561]: DEBUG dbcounter [-] [77561] Writing DB stats cinder:UPDATE=1 {{(pid=77561) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:37:21 devstack cinder-volume[77354]: INFO oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Caught SIGTERM, stopping children Jul 24 12:37:21 devstack cinder-volume[77354]: DEBUG oslo_concurrency.lockutils [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Acquiring lock "singleton_lock" {{(pid=77354) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 12:37:21 devstack cinder-volume[77354]: DEBUG oslo_concurrency.lockutils [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Acquired lock "singleton_lock" {{(pid=77354) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 12:37:21 devstack cinder-volume[77354]: DEBUG oslo_concurrency.lockutils [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Releasing lock "singleton_lock" {{(pid=77354) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 12:37:21 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Stop services. {{(pid=77354) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 24 12:37:21 devstack cinder-volume[77354]: DEBUG oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Killing children. {{(pid=77354) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 24 12:37:21 devstack cinder-volume[77354]: INFO oslo_service.backend._eventlet.service [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Waiting on 1 children to exit Jul 24 12:37:23 devstack cinder-volume[77561]: DEBUG oslo_service.periodic_task [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:37:23 devstack cinder-volume[77561]: DEBUG cinder.volume.drivers.lvm [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Updating volume stats {{(pid=77561) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 12:37:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:23 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 12:37:23 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:23 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:23 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:23 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:37:23 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:24 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:24 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 12:37:24 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:24 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:24 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 12:37:24 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:24 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:24 devstack cinder-volume[77561]: DEBUG oslo_concurrency.processutils [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=77561) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:24 devstack cinder-volume[77561]: DEBUG cinder.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Notifying Schedulers of capabilities ... {{(pid=77561) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:37:24 devstack cinder-volume[77561]: DEBUG oslo_service.periodic_task [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] Running periodic task VolumeManager._thread_info {{(pid=77561) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:37:24 devstack cinder-volume[77561]: DEBUG cinder.volume.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] thread count: 6 {{(pid=77561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:37:24 devstack cinder-volume[77561]: DEBUG cinder.volume.manager [None req-e749e863-8df3-4432-9643-f8bf51c32687 None None] thread info: [<_MainThread(MainThread, started 133964690587776)>, , , , , ] {{(pid=77561) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:37:26 devstack cinder-volume[77561]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 24 12:37:27 devstack cinder-volume[87572]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 12:37:27 devstack cinder-volume[87572]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 12:37:27 devstack cinder-volume[87572]: we strongly recommend against using it for new projects. Jul 24 12:37:27 devstack cinder-volume[87572]: If you are already using Eventlet, we recommend migrating to a different Jul 24 12:37:27 devstack cinder-volume[87572]: framework. For more detail see Jul 24 12:37:27 devstack cinder-volume[87572]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 12:37:27 devstack cinder-volume[87572]: import eventlet # noqa Jul 24 12:37:29 devstack cinder-volume[87572]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 12:37:29 devstack cinder-volume[87572]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 12:37:29 devstack cinder-volume[87572]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 12:37:29 devstack cinder-volume[87572]: INFO dbcounter [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Registered counter for database cinder Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_db.sqlalchemy.engines [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:37:30 devstack cinder-volume[77561]: DEBUG oslo_concurrency.lockutils [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Acquiring lock "singleton_lock" {{(pid=77561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 12:37:30 devstack cinder-volume[77561]: DEBUG oslo_concurrency.lockutils [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Acquired lock "singleton_lock" {{(pid=77561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 12:37:30 devstack cinder-volume[77561]: DEBUG oslo_concurrency.lockutils [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Releasing lock "singleton_lock" {{(pid=77561) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 12:37:30 devstack cinder-volume[77561]: WARNING amqp [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 12:37:30 devstack cinder-volume[77561]: WARNING amqp [None req-5fa01b29-3277-4bf9-8ba0-6c51f3692bc3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG dbcounter [-] [87572] Writer thread running {{(pid=87572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 12:37:30 devstack cinder-volume[87572]: INFO cinder.rpc [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 12:37:30 devstack cinder-volume[87572]: INFO cinder.rpc [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_db.sqlalchemy.engines [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:37:30 devstack cinder-volume[87572]: INFO cinder.volume.manager [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Determined volume DB was empty at startup. Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG cinder.volume.manager [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87572) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 12:37:30 devstack cinder-volume[87572]: INFO cinder.volume.manager [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 24 12:37:30 devstack cinder-volume[87572]: WARNING stevedore.named [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 12:37:30 devstack cinder-volume[87572]: WARNING castellan.key_manager [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 12:37:30 devstack cinder-volume[87572]: WARNING cinder.keymgr.conf_key_mgr [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 12:37:30 devstack cinder-volume[87572]: INFO cinder.volume.manager [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_db.sqlalchemy.engines [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:37:30 devstack cinder-volume[87572]: INFO oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Starting 1 workers Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Started child 87791 {{(pid=87572) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Full set of CONF: {{(pid=87572) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] ******************************************************************************** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Configuration options gathered from: {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] ================================================================================ {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] allow_availability_zone_fallback = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] allow_compression_on_image_upload = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] allowed_direct_url_schemes = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] api_rate_limit = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] auth_strategy = keystone {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_availability_zone = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_host = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_stats_polling_interval = 60 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backup_api_class = cinder.backup.api.API {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87791]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backup_name_template = backup-%s {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backup_use_same_host = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backup_use_temp_snapshot = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] chap_password = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] chap_username = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cinder_internal_tenant_project_id = db73dd98ac574b52ad6eef50d8f193ed {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cinder_internal_tenant_user_id = 9085e80a91d043538ce301e4337ddd66 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cluster = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] compression_format = gzip {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] compute_api_class = cinder.compute.nova.API {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] config_dir = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] config_source = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] control_exchange = openstack {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] debug = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] default_availability_zone = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] default_group_type = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] default_volume_type = QuobyteHD {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] disk_geometry = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] driver_client_cert = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] driver_client_cert_key = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] driver_data_namespace = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] driver_ssl_cert_path = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] driver_ssl_cert_verify = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] driver_use_ssl = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] enable_new_services = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] enable_unsupported_driver = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] enabled_backends = ['QuobyteHD'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] enforce_multipath_for_image_xfer = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] filter_function = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_api_insecure = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_api_servers = ['http://192.168.122.192/image'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_api_ssl_compression = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_ca_certificates_file = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_catalog_info = image:glance:publicURL {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_certfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_keyfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_num_retries = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance_request_timeout = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] goodness_function = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] graceful_shutdown_timeout = 5 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] group_api_class = cinder.group.api.API {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] host = devstack {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_compress_on_upload = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_conversion_address_space_limit = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_conversion_cpu_limit = 60 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_conversion_disable = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_upload_use_cinder_backend = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_upload_use_internal_tenant = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_volume_cache_enabled = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_volume_cache_max_count = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] image_volume_cache_max_size_gb = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] init_host_max_objects_retrieval = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] instance_format = [instance: %(uuid)s] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] iscsi_target_flags = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] iscsi_write_cache = on {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] iser_helper = tgtadm {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] iser_ip_address = 192.168.122.192 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] iser_port = 3260 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] log_color = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] log_config_append = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] log_dir = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] log_file = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] log_options = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] log_rotate_interval = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] log_rotate_interval_type = days {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] log_rotation_type = none {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] max_age = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] max_logfile_count = 30 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] max_logfile_size_mb = 200 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] max_over_subscription_ratio = 20.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] message_reap_interval = 86400 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] message_ttl = 2592000 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] migration_create_volume_timeout_secs = 300 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] monkey_patch = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] monkey_patch_modules = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] my_ip = 192.168.122.192 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] no_snapshot_gb_quota = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] num_iser_scan_tries = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] num_shell_tries = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] num_volume_device_scan_tries = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] nvmeof_conn_info_version = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] nvmet_ns_id = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] nvmet_port_id = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] osapi_max_limit = 1000 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] osapi_volume_ext_list = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] osapi_volume_listen = 0.0.0.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] osapi_volume_listen_port = 8776 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] osapi_volume_use_ssl = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] osapi_volume_workers = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] per_volume_size_limit = -1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] periodic_fuzzy_delay = 60 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] periodic_interval = 60 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] project_id_regex = [0-9a-f\-]+ {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] public_endpoint = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] publish_errors = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] quota_backup_gigabytes = 1000 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] quota_backups = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] quota_gigabytes = 1000 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] quota_groups = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] quota_snapshots = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] quota_volumes = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] rate_limit_burst = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] rate_limit_except_level = CRITICAL {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] rate_limit_interval = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] reinit_driver_count = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87791]: INFO cinder.volume.manager [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Starting volume driver QuobyteDriver (1.2) Jul 24 12:37:30 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.remotefs [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87791) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] replication_device = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] report_discard_supported = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] report_interval = 120 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] reservation_clean_interval = 86400 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] reservation_expire = 86400 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] reserved_image_namespaces = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] reserved_percentage = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] rpc_response_timeout = 120 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] run_external_periodic_tasks = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] scst_target_driver = iscsi {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] scst_target_iqn_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_down_time = 720 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] shell_completion = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] snapshot_name_template = snapshot-%s {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] split_loggers = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] state_path = /opt/stack/data/cinder {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] storage_availability_zone = nova {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] storage_protocol = iSCSI {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] syslog_log_facility = LOG_USER {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] target_helper = lioadm {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] target_ip_address = 192.168.122.192 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] target_port = 3260 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] target_protocol = iscsi {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] target_secondary_ip_addresses = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] trace_flags = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] transfer_api_class = cinder.transfer.api.API {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] transport_url = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] until_refresh = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] use_chap_auth = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] use_default_quota_class = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] use_journal = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] use_json = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] use_multipath_for_image_xfer = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] use_stderr = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] use_syslog = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] verify_glance_signatures = enabled {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_api_class = cinder.volume.api.API {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_backend_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_clear = zero {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_clear_ionice = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_clear_size = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_copy_bps_limit = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_dd_blocksize = 1M {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_name_template = volume-%s {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_service_inithost_offload = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volume_usage_audit_period = month {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] zoning_mode = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_concurrency.disable_process_locking = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.auth_section = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.auth_type = password {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.auth_version = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.cache = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.certfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.delay_auth_decision = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.http_connect_timeout = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.include_service_catalog = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.insecure = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.interface = public {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.keyfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_password = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcache_username = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.region_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.service_token_roles_required = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.service_type = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.token_cache_time = 300 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.backend = dogpile.cache.null {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.backend_argument = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.backend_expiration_time = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.config_prefix = cache.oslo {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.debug_cache_backend = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.enable_retry_client = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.enable_socket_keepalive = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.enabled = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.expiration_time = 600 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.hashclient_retry_attempts = 2 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.memcache_dead_retry = 300 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.memcache_pool_maxsize = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.memcache_sasl_enabled = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.password = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.proxies = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.redis_db = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.redis_sentinel_service_name = mymaster {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.redis_server = localhost:6379 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.retry_attempts = 2 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.retry_delay = 0.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.socket_keepalive_count = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.socket_keepalive_idle = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.socket_keepalive_interval = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.socket_timeout = 1.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.tls_allowed_ciphers = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.tls_cafile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.tls_certfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.tls_enabled = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.tls_keyfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cache.username = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] coordination.backend_url = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.asyncio_connection = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.asyncio_slave_connection = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.backend = sqlalchemy {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.connection = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.connection_debug = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.connection_parameters = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.connection_recycle_time = 3600 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.connection_trace = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.db_inc_retry_interval = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.db_max_retries = 20 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.db_max_retry_interval = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.db_retry_interval = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.max_overflow = 50 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.max_pool_size = 5 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.max_retries = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.mysql_wsrep_sync_wait = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.pool_timeout = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.retry_interval = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.slave_connection = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.sqlite_synchronous = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.synchronous_reader = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] database.use_db_reconnect = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.connection_string = messaging:// {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.enabled = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.es_doc_type = notification {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.es_scroll_size = 10000 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.es_scroll_time = 2m {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.filter_error_trace = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.hmac_keys = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.sentinel_service_name = mymaster {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.socket_timeout = 0.1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.trace_requests = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler.trace_sqlalchemy = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler_jaeger.process_tags = {} {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler_jaeger.service_name_prefix = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] profiler_otlp.service_name_prefix = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.enforce_new_defaults = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.policy_default_rule = default {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.policy_file = policy.yaml {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:30 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_policy.remote_timeout = 60.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] privsep_osbrick.group = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] privsep_osbrick.helper_command = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] privsep_osbrick.user = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cinder_sys_admin.group = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cinder_sys_admin.helper_command = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] cinder_sys_admin.user = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.auth_section = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.auth_type = password {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.cafile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.certfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.collect_timing = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.insecure = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.keyfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.send_service_user_token = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.split_loggers = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] service_user.timeout = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.auth_section = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.auth_type = password {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.certfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.collect_timing = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.insecure = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.keyfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.region_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.split_loggers = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] glance.timeout = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.backend_availability_zone = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.chap_password = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.chap_username = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.disk_geometry = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.driver_client_cert = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.driver_client_cert_key = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.driver_data_namespace = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.driver_use_ssl = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.enable_unsupported_driver = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.extra_capabilities = {} {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.filter_function = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.goodness_function = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.iscsi_target_flags = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.iscsi_write_cache = on {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.iser_helper = tgtadm {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.iser_port = 3260 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_host = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_login = admin {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_mount_options = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_password = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_private_key = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_share_path = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_ssh_port = 22 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.num_shell_tries = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.nvmet_port_id = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.quobyte_client_cfg = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.quobyte_volume_url = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.replication_device = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.report_discard_supported = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.reserved_percentage = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.scst_target_driver = iscsi {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.scst_target_iqn_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.storage_protocol = iSCSI {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.target_helper = tgtadm {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.target_port = 3260 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.target_protocol = iscsi {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.trace_flags = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.unique_fqdn_network = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.use_chap_auth = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.volume_backend_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.volume_clear = zero {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.volume_clear_ionice = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.volume_clear_size = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_reports.file_event_handler = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_reports.log_dir = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.backend_availability_zone = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.backend_host = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.chap_password = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.chap_username = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.chiscsi_conf = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.disk_geometry = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.driver_client_cert = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.driver_client_cert_key = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.driver_data_namespace = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.driver_use_ssl = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.extra_capabilities = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.filter_function = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.goodness_function = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.iscsi_target_flags = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.iscsi_write_cache = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.iser_helper = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.iser_ip_address = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.iser_port = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.iser_target_prefix = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_host = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_login = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_mount_options = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_password = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_private_key = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_share_path = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_ssh_port = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.num_shell_tries = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87791) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 24 12:37:31 devstack cinder-volume[87791]: WARNING cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nvmet_ns_id = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.nvmet_port_id = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87791]: WARNING cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.replication_device = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.report_discard_supported = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.reserved_percentage = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.scst_target_driver = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.storage_protocol = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.target_helper = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.target_ip_address = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.target_port = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.target_prefix = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.target_protocol = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.trace_flags = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Running cmd (subprocess): mount.quobyte {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.unique_fqdn_network = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.use_chap_auth = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.volume_clear = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.volume_clear_ionice = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.volume_clear_size = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] QuobyteHD.volumes_dir = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.ssl = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.ssl_version = {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_notifications.driver = [] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_notifications.retry = -1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] oslo_messaging_notifications.transport_url = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] key_manager.fixed_key = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.barbican_api_version = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.barbican_endpoint = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.barbican_endpoint_type = public {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.barbican_region_name = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.cafile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.certfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.collect_timing = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.insecure = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.keyfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.number_of_retries = 60 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.retry_delay = 1 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.send_service_user_token = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.split_loggers = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.timeout = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.verify_ssl = True {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican.verify_ssl_path = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican_service_user.auth_section = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican_service_user.auth_type = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican_service_user.cafile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican_service_user.certfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican_service_user.collect_timing = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican_service_user.insecure = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican_service_user.keyfile = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican_service_user.split_loggers = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] barbican_service_user.timeout = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.approle_role_id = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.approle_secret_id = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.auth_method = approle {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.auth_path = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.kv_mountpoint = secret {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.kv_path = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.kv_version = 2 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.namespace = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.root_token_id = **** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.ssl_ca_crt_file = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.timeout = 60.0 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.token_file = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.token_role = None {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.use_ssl = False {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:31 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] ******************************************************************************** {{(pid=87572) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 12:37:31 devstack quobyte-client[87797]: Reading configuration file: /etc/quobyte/client.cfg Jul 24 12:37:31 devstack quobyte-client[87797]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=87791) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:37:31 devstack cinder-volume[87791]: INFO cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 ... Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 -c /etc/quobyte/client-cinder.cfg {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:31 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 -c /etc/quobyte/client-cinder.cfg Jul 24 12:37:31 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:31 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.383s {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:31 devstack cinder-volume[87791]: INFO cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 succeeded Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=87791) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.393s {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:31 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:37:31 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:31 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.247s {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:31 devstack cinder-volume[87791]: INFO cinder.volume.driver [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Driver hasn't implemented _init_vendor_properties() Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG cinder.volume.driver [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87791) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_db.sqlalchemy.engines [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87791) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG dbcounter [-] [87791] Writer thread running {{(pid=87791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG cinder.db.api [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Building query based on filter {{(pid=87791) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG cinder.image.image_utils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87791) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 12:37:31 devstack cinder-volume[87791]: INFO cinder.keymgr.migration [None req-bf93d7a6-887c-4362-b8a1-bb4882126274 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=87791) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=87791) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:37:31 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:31 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:37:31 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:32 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.243s {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG cinder.manager [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Notifying Schedulers of capabilities ... {{(pid=87791) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:37:32 devstack cinder-volume[87791]: INFO cinder.volume.manager [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Driver initialization completed successfully. Jul 24 12:37:32 devstack cinder-volume[87791]: INFO cinder.manager [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Initiating service 3 cleanup Jul 24 12:37:32 devstack cinder-volume[87791]: INFO cinder.manager [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Service 3 cleanup completed. Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG cinder.service [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Creating RPC server for service cinder-volume {{(pid=87791) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG cinder.service [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87791) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 12:37:32 devstack cinder-volume[87791]: INFO cinder.volume.manager [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=87791) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.quobyte [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=87791) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:32 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:37:32 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:32 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:32 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.254s {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:32 devstack cinder-volume[87791]: INFO cinder.volume.manager [None req-5aeae32c-6e1a-4923-bee8-a5505fa908aa None None] Driver post RPC initialization completed successfully. Jul 24 12:37:37 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5916d0ea-f2d4-4dcb-a47e-3b03aa0412a5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:37:37 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5916d0ea-f2d4-4dcb-a47e-3b03aa0412a5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:37:37 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.quobyte [None req-5916d0ea-f2d4-4dcb-a47e-3b03aa0412a5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=87791) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:37:37 devstack cinder-volume[87791]: DEBUG cinder.volume.drivers.quobyte [None req-5916d0ea-f2d4-4dcb-a47e-3b03aa0412a5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=87791) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:37:37 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-5916d0ea-f2d4-4dcb-a47e-3b03aa0412a5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87791) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:37:37 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5916d0ea-f2d4-4dcb-a47e-3b03aa0412a5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:37 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:37:37 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:37 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:37 devstack cinder-volume[87791]: DEBUG oslo_concurrency.processutils [None req-5916d0ea-f2d4-4dcb-a47e-3b03aa0412a5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.222s {{(pid=87791) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:37 devstack cinder-volume[87791]: DEBUG cinder.manager [None req-5916d0ea-f2d4-4dcb-a47e-3b03aa0412a5 None None] Notifying Schedulers of capabilities ... {{(pid=87791) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:37:39 devstack cinder-volume[87572]: INFO oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Caught SIGTERM, stopping children Jul 24 12:37:39 devstack cinder-volume[87572]: DEBUG oslo_concurrency.lockutils [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Acquiring lock "singleton_lock" {{(pid=87572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 12:37:39 devstack cinder-volume[87572]: DEBUG oslo_concurrency.lockutils [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Acquired lock "singleton_lock" {{(pid=87572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 12:37:39 devstack cinder-volume[87572]: DEBUG oslo_concurrency.lockutils [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Releasing lock "singleton_lock" {{(pid=87572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 12:37:39 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Stop services. {{(pid=87572) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 24 12:37:39 devstack cinder-volume[87572]: DEBUG oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Killing children. {{(pid=87572) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 24 12:37:39 devstack cinder-volume[87572]: INFO oslo_service.backend._eventlet.service [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Waiting on 1 children to exit Jul 24 12:37:42 devstack cinder-volume[87791]: DEBUG dbcounter [-] [87791] Writing DB stats cinder:SELECT=3 {{(pid=87791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:37:42 devstack cinder-volume[87791]: DEBUG dbcounter [-] [87791] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87791) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:37:44 devstack cinder-volume[87791]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 24 12:37:45 devstack cinder-volume[88247]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 12:37:45 devstack cinder-volume[88247]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 12:37:45 devstack cinder-volume[88247]: we strongly recommend against using it for new projects. Jul 24 12:37:45 devstack cinder-volume[88247]: If you are already using Eventlet, we recommend migrating to a different Jul 24 12:37:45 devstack cinder-volume[88247]: framework. For more detail see Jul 24 12:37:45 devstack cinder-volume[88247]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 12:37:45 devstack cinder-volume[88247]: import eventlet # noqa Jul 24 12:37:45 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Acquiring lock "singleton_lock" {{(pid=87791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 12:37:45 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Acquired lock "singleton_lock" {{(pid=87791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 12:37:45 devstack cinder-volume[87791]: DEBUG oslo_concurrency.lockutils [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Releasing lock "singleton_lock" {{(pid=87791) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 12:37:45 devstack cinder-volume[87791]: WARNING amqp [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 12:37:45 devstack cinder-volume[87791]: WARNING amqp [None req-54ecaed0-74ed-4893-881f-32bb07a36b7e None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 12:37:47 devstack cinder-volume[88247]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88247) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 12:37:47 devstack cinder-volume[88247]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88247) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 12:37:47 devstack cinder-volume[88247]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88247) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 12:37:48 devstack cinder-volume[88247]: INFO dbcounter [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Registered counter for database cinder Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_db.sqlalchemy.engines [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG dbcounter [-] [88247] Writer thread running {{(pid=88247) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 12:37:48 devstack cinder-volume[88247]: INFO cinder.rpc [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 12:37:48 devstack cinder-volume[88247]: INFO cinder.rpc [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_db.sqlalchemy.engines [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:37:48 devstack cinder-volume[88247]: INFO cinder.volume.manager [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Determined volume DB was empty at startup. Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG cinder.volume.manager [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88247) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 12:37:48 devstack cinder-volume[88247]: WARNING stevedore.named [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 12:37:48 devstack cinder-volume[88247]: WARNING castellan.key_manager [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 12:37:48 devstack cinder-volume[88247]: WARNING cinder.keymgr.conf_key_mgr [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 12:37:48 devstack cinder-volume[88247]: INFO cinder.volume.manager [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_db.sqlalchemy.engines [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88247) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:37:48 devstack cinder-volume[88247]: INFO oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Starting 1 workers Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Started child 88540 {{(pid=88247) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Full set of CONF: {{(pid=88247) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] ******************************************************************************** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] Configuration options gathered from: {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] ================================================================================ {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] allow_availability_zone_fallback = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] allow_compression_on_image_upload = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88540]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] allowed_direct_url_schemes = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] api_rate_limit = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] auth_strategy = keystone {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_availability_zone = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_host = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_stats_polling_interval = 60 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backup_api_class = cinder.backup.api.API {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backup_name_template = backup-%s {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backup_use_same_host = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backup_use_temp_snapshot = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] chap_password = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] chap_username = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cinder_internal_tenant_project_id = db73dd98ac574b52ad6eef50d8f193ed {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cinder_internal_tenant_user_id = 9085e80a91d043538ce301e4337ddd66 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cluster = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] compression_format = gzip {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] compute_api_class = cinder.compute.nova.API {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] config_dir = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] config_source = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] control_exchange = openstack {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] debug = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] default_availability_zone = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] default_group_type = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] default_volume_type = QuobyteHD {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] disk_geometry = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] driver_client_cert = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] driver_client_cert_key = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] driver_data_namespace = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] driver_ssl_cert_path = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] driver_ssl_cert_verify = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] driver_use_ssl = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] enable_new_services = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] enable_unsupported_driver = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] enabled_backends = ['QuobyteHD'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] enforce_multipath_for_image_xfer = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] filter_function = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_api_insecure = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_api_servers = ['http://192.168.122.192/image'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_api_ssl_compression = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_ca_certificates_file = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_catalog_info = image:glance:publicURL {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_certfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_keyfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_num_retries = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance_request_timeout = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] goodness_function = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] graceful_shutdown_timeout = 5 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] group_api_class = cinder.group.api.API {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] host = devstack {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_compress_on_upload = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_conversion_address_space_limit = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_conversion_cpu_limit = 60 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_conversion_disable = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_upload_use_cinder_backend = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_upload_use_internal_tenant = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_volume_cache_enabled = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_volume_cache_max_count = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] image_volume_cache_max_size_gb = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] init_host_max_objects_retrieval = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] instance_format = [instance: %(uuid)s] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] iscsi_target_flags = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] iscsi_write_cache = on {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] iser_helper = tgtadm {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] iser_ip_address = 192.168.122.192 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] iser_port = 3260 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] log_color = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] log_config_append = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] log_dir = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Starting volume driver QuobyteDriver (1.2) Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] log_file = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88540) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] log_options = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] log_rotate_interval = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] log_rotate_interval_type = days {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] log_rotation_type = none {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] max_age = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] max_logfile_count = 30 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] max_logfile_size_mb = 200 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] max_over_subscription_ratio = 20.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] message_reap_interval = 86400 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] message_ttl = 2592000 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] migration_create_volume_timeout_secs = 300 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] monkey_patch = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] monkey_patch_modules = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] my_ip = 192.168.122.192 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] no_snapshot_gb_quota = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] num_iser_scan_tries = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] num_shell_tries = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] num_volume_device_scan_tries = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] nvmeof_conn_info_version = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] nvmet_ns_id = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] nvmet_port_id = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] osapi_max_limit = 1000 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] osapi_volume_ext_list = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] osapi_volume_listen_port = 8776 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] osapi_volume_use_ssl = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] osapi_volume_workers = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] per_volume_size_limit = -1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] periodic_fuzzy_delay = 60 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] periodic_interval = 60 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] public_endpoint = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] publish_errors = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] quota_backup_gigabytes = 1000 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] quota_backups = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] quota_gigabytes = 1000 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] quota_groups = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] quota_snapshots = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] quota_volumes = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] rate_limit_burst = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] rate_limit_except_level = CRITICAL {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] rate_limit_interval = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] reinit_driver_count = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] replication_device = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] report_discard_supported = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] report_interval = 120 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] reservation_clean_interval = 86400 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] reservation_expire = 86400 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] reserved_image_namespaces = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] reserved_percentage = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] rpc_response_timeout = 120 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] run_external_periodic_tasks = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] scst_target_driver = iscsi {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] scst_target_iqn_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_down_time = 720 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] shell_completion = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] snapshot_name_template = snapshot-%s {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] split_loggers = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] state_path = /opt/stack/data/cinder {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] storage_availability_zone = nova {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] storage_protocol = iSCSI {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] syslog_log_facility = LOG_USER {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] target_helper = lioadm {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] target_ip_address = 192.168.122.192 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] target_port = 3260 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] target_protocol = iscsi {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] target_secondary_ip_addresses = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] trace_flags = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] transport_url = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] until_refresh = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] use_chap_auth = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] use_default_quota_class = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] use_journal = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] use_json = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] use_multipath_for_image_xfer = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] use_stderr = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] use_syslog = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] verify_glance_signatures = enabled {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_api_class = cinder.volume.api.API {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_backend_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_clear = zero {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_clear_ionice = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_clear_size = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_copy_bps_limit = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_dd_blocksize = 1M {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_name_template = volume-%s {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_service_inithost_offload = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volume_usage_audit_period = month {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] zoning_mode = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_concurrency.disable_process_locking = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.auth_section = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.auth_type = password {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.auth_version = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.cache = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.certfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.include_service_catalog = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.insecure = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.interface = public {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.keyfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_password = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcache_username = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.region_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.service_type = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.192/identity {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.backend = dogpile.cache.null {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.backend_argument = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.backend_expiration_time = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.config_prefix = cache.oslo {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.debug_cache_backend = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.enable_retry_client = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.enable_socket_keepalive = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.enabled = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.expiration_time = 600 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.hashclient_retry_attempts = 2 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.memcache_dead_retry = 300 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.memcache_pool_maxsize = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.memcache_sasl_enabled = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.password = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.proxies = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.redis_db = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88540) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 24 12:37:48 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.quobyte [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.redis_server = localhost:6379 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.retry_attempts = 2 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.quobyte [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.retry_delay = 0.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.socket_keepalive_count = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.socket_keepalive_idle = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.socket_keepalive_interval = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Running cmd (subprocess): mount.quobyte {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.socket_timeout = 1.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.tls_allowed_ciphers = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.tls_cafile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.tls_certfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.tls_enabled = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.tls_keyfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cache.username = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] coordination.backend_url = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.asyncio_connection = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.asyncio_slave_connection = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.backend = sqlalchemy {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.connection = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.connection_debug = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:48 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.connection_parameters = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.connection_recycle_time = 3600 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.connection_trace = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.db_inc_retry_interval = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.db_max_retries = 20 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.db_max_retry_interval = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.db_retry_interval = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.max_overflow = 50 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.max_pool_size = 5 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.max_retries = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.mysql_wsrep_sync_wait = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.pool_timeout = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.retry_interval = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.slave_connection = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.sqlite_synchronous = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.synchronous_reader = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] database.use_db_reconnect = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.connection_string = messaging:// {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.enabled = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.es_doc_type = notification {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.es_scroll_size = 10000 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.es_scroll_time = 2m {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.filter_error_trace = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.hmac_keys = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.sentinel_service_name = mymaster {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.socket_timeout = 0.1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.trace_requests = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler.trace_sqlalchemy = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler_jaeger.process_tags = {} {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler_jaeger.service_name_prefix = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] profiler_otlp.service_name_prefix = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.enforce_new_defaults = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.policy_default_rule = default {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.policy_file = policy.yaml {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] privsep_osbrick.group = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] privsep_osbrick.helper_command = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] privsep_osbrick.user = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cinder_sys_admin.group = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cinder_sys_admin.helper_command = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] cinder_sys_admin.user = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.auth_section = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.auth_type = password {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.cafile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.certfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.collect_timing = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.insecure = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.keyfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.send_service_user_token = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.split_loggers = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] service_user.timeout = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.auth_section = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.auth_type = password {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.certfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.collect_timing = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.insecure = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.keyfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.region_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.split_loggers = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] glance.timeout = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.backend_availability_zone = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.chap_password = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.chap_username = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.disk_geometry = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.driver_client_cert = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.driver_client_cert_key = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.driver_data_namespace = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.driver_use_ssl = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.extra_capabilities = {} {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.filter_function = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.goodness_function = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack quobyte-client[88552]: Reading configuration file: /etc/quobyte/client.cfg Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.iscsi_target_flags = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.iscsi_write_cache = on {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.iser_helper = tgtadm {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.iser_ip_address = 192.168.122.192 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.iser_port = 3260 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack quobyte-client[88552]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_host = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_login = admin {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_mount_options = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_password = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] CMD "mount.quobyte" returned: 1 in 0.055s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_private_key = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_share_path = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.num_shell_tries = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.quobyte_volume_url = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.replication_device = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.report_discard_supported = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.reserved_percentage = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.target_helper = tgtadm {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.target_ip_address = 192.168.122.192 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.target_port = 3260 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.target_protocol = iscsi {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.trace_flags = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.unique_fqdn_network = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.use_chap_auth = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.volume_backend_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.volume_clear = zero {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.volume_clear_ionice = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.volume_clear_size = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_reports.file_event_handler = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_reports.log_dir = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.backend_availability_zone = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.backend_host = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.chap_password = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.chap_username = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.chiscsi_conf = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.disk_geometry = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.driver_client_cert = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.driver_data_namespace = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.driver_use_ssl = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.extra_capabilities = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.filter_function = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.goodness_function = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.iser_helper = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.iser_ip_address = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.iser_port = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.iser_target_prefix = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_host = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_login = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_mount_options = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_password = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_private_key = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_share_path = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_ssh_port = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.num_shell_tries = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.nvmet_port_id = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.replication_device = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.report_discard_supported = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.reserved_percentage = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.scst_target_driver = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.storage_protocol = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.target_helper = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.target_ip_address = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.target_port = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.target_prefix = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.target_protocol = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.trace_flags = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.use_chap_auth = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.volume_clear = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.volume_clear_size = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] QuobyteHD.volumes_dir = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.ssl = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_notifications.driver = [] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_notifications.retry = -1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] key_manager.fixed_key = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.barbican_api_version = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.barbican_endpoint = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.barbican_endpoint_type = public {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.barbican_region_name = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.cafile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.certfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.collect_timing = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.insecure = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.keyfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.number_of_retries = 60 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.retry_delay = 1 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.send_service_user_token = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.split_loggers = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.timeout = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.verify_ssl = True {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican.verify_ssl_path = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican_service_user.auth_section = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican_service_user.auth_type = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican_service_user.cafile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican_service_user.certfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican_service_user.collect_timing = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican_service_user.insecure = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican_service_user.keyfile = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican_service_user.split_loggers = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] barbican_service_user.timeout = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.approle_role_id = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.approle_secret_id = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.auth_method = approle {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.auth_path = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.kv_mountpoint = secret {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.kv_path = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.kv_version = 2 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.namespace = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.root_token_id = **** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.ssl_ca_crt_file = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.timeout = 60.0 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.token_file = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.token_role = None {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.use_ssl = False {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 12:37:49 devstack cinder-volume[88247]: DEBUG oslo_service.backend._eventlet.service [None req-d018f5dd-d0f3-4a22-a5bf-e2147d2b2789 None None] ******************************************************************************** {{(pid=88247) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 12:37:49 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.221s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:49 devstack cinder-volume[88540]: INFO cinder.volume.driver [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.volume.driver [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88540) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_db.sqlalchemy.engines [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88540) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writer thread running {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.db.api [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Building query based on filter {{(pid=88540) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88540) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:49 devstack cinder-volume[88540]: INFO cinder.keymgr.migration [None req-6f4df75d-f3d6-48f6-a2e3-847d31035014 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 12:37:49 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:37:49 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:49 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.240s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:37:49 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Driver initialization completed successfully. Jul 24 12:37:49 devstack cinder-volume[88540]: INFO cinder.manager [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Initiating service 3 cleanup Jul 24 12:37:49 devstack cinder-volume[88540]: INFO cinder.manager [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Service 3 cleanup completed. Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.service [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Creating RPC server for service cinder-volume {{(pid=88540) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.service [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88540) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 12:37:49 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:37:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:37:49 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:37:49 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:37:50 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Jul 24 12:37:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.242s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:37:50 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0724888f-0376-4db4-b35c-f1d814dddc14 None None] Driver post RPC initialization completed successfully. Jul 24 12:37:58 devstack cinder-volume[88247]: DEBUG dbcounter [-] [88247] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88247) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:37:59 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:38:00 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=3 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:38:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:38:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 6 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:38:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Flow 'volume_create_manager' (0aa481f2-7602-4c21-b481-e36d7d3d176a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bde897-376e-4386-82e8-54ffbe11d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6bde897-376e-4386-82e8-54ffbe11d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1844445130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488c9eb6-d256-4aba-b914-98fd26c95837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc2475d592472da6b4621c3de37cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:39:10Z,use_quota=True,user_id='b06ed65542be4ebda7919e5a08075356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c269a298-5bd1-43ab-8846-ab8a2bef37da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c269a298-5bd1-43ab-8846-ab8a2bef37da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef0297b-fb10-4467-b3c0-6ee99b88104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef0297b-fb10-4467-b3c0-6ee99b88104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488c9eb6-d256-4aba-b914-98fd26c95837', 'volume_name': 'volume-488c9eb6-d256-4aba-b914-98fd26c95837', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7cafe0-e72a-47b5-8b3c-5e2c4c05fde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7cafe0-e72a-47b5-8b3c-5e2c4c05fde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d16e431-f8f6-4f76-8172-69c7b3767477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:10 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Volume 488c9eb6-d256-4aba-b914-98fd26c95837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488c9eb6-d256-4aba-b914-98fd26c95837', 'volume_size': 1} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1844445130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488c9eb6-d256-4aba-b914-98fd26c95837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7cc2475d592472da6b4621c3de37cc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:39:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:39:10Z,use_quota=True,user_id='b06ed65542be4ebda7919e5a08075356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Creating volume 488c9eb6-d256-4aba-b914-98fd26c95837 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:39:10 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:39:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:10 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837 1073741824 Jul 24 12:39:10 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:11 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837 1073741824" returned: 0 in 1.268s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:11 devstack sudo[89563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837 Jul 24 12:39:11 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:12 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837" returned: 0 in 0.679s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:39:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d16e431-f8f6-4f76-8172-69c7b3767477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488c9eb6-d256-4aba-b914-98fd26c95837', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6170528c-0631-4999-bd3e-d6db7bc0fd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:12 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Volume volume-488c9eb6-d256-4aba-b914-98fd26c95837 (488c9eb6-d256-4aba-b914-98fd26c95837): created successfully Jul 24 12:39:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6170528c-0631-4999-bd3e-d6db7bc0fd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Flow 'volume_create_manager' (0aa481f2-7602-4c21-b481-e36d7d3d176a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:39:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-045b8ca2-00e7-4c03-b66e-9bedb7b9b228 tempest-DeleteServersTestJSON-775660950 None] Created volume successfully. Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Flow 'volume_create_manager' (c70e9469-b1e8-4697-b6c8-482537e8a4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17aa44b-1956-42d3-a2fb-0bea7f0539f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17aa44b-1956-42d3-a2fb-0bea7f0539f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-735508399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10cb58d-d595-4411-a3ad-12dc3b08193c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3560304aad47c59f7eb05311a4d4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:39:13Z,use_quota=True,user_id='deffdfec1bfb4cfeae0cb8b716008ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69355dc5-0afe-4137-9e77-d090894613f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69355dc5-0afe-4137-9e77-d090894613f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b515611d-c1ea-48fc-b7a1-629095127137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b515611d-c1ea-48fc-b7a1-629095127137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10cb58d-d595-4411-a3ad-12dc3b08193c', 'volume_name': 'volume-d10cb58d-d595-4411-a3ad-12dc3b08193c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924a61bc-77ff-44a6-a4ae-f4b9eecd5c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924a61bc-77ff-44a6-a4ae-f4b9eecd5c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e3028d-133a-4249-9031-f6b5aaf60ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:13 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Volume d10cb58d-d595-4411-a3ad-12dc3b08193c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10cb58d-d595-4411-a3ad-12dc3b08193c', 'volume_size': 1} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:39:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-735508399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10cb58d-d595-4411-a3ad-12dc3b08193c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de3560304aad47c59f7eb05311a4d4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:39:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:39:13Z,use_quota=True,user_id='deffdfec1bfb4cfeae0cb8b716008ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Creating volume d10cb58d-d595-4411-a3ad-12dc3b08193c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:39:13 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:39:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:13 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c 1073741824 Jul 24 12:39:13 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:14 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c 1073741824" returned: 0 in 0.873s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:14 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c Jul 24 12:39:14 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:14 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c" returned: 0 in 0.573s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:39:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e3028d-133a-4249-9031-f6b5aaf60ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10cb58d-d595-4411-a3ad-12dc3b08193c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eeb72ad-16ab-4f3b-b68e-0d9bbc0c84f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:14 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Volume volume-d10cb58d-d595-4411-a3ad-12dc3b08193c (d10cb58d-d595-4411-a3ad-12dc3b08193c): created successfully Jul 24 12:39:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eeb72ad-16ab-4f3b-b68e-0d9bbc0c84f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Flow 'volume_create_manager' (c70e9469-b1e8-4697-b6c8-482537e8a4a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:39:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5eedac2a-b125-45e7-83fe-b0c2ee282e65 tempest-VolumesAdminNegativeTest-355384182 None] Created volume successfully. Jul 24 12:39:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Acquiring lock "cinder-d10cb58d-d595-4411-a3ad-12dc3b08193c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:39:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Lock "cinder-d10cb58d-d595-4411-a3ad-12dc3b08193c-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:39:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Acquiring lock "cinder-quobyte-d10cb58d-d595-4411-a3ad-12dc3b08193c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:39:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Lock "cinder-quobyte-d10cb58d-d595-4411-a3ad-12dc3b08193c" acquired by "delete_volume" :: waited 0.042s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:39:16 devstack cinder-volume[88540]: INFO oslo.privsep.daemon [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy41l5wmz/privsep.sock'] Jul 24 12:39:16 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy41l5wmz/privsep.sock Jul 24 12:39:16 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:17 devstack cinder-volume[88540]: WARNING py.warnings [req-4c2940bf-b68e-4a26-8b47-d6eba00d2dde req-3bee259c-204a-4c8e-aef7-685a62107e6f tempest-DeleteServersTestJSON-775660950 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 24 12:39:17 devstack cinder-volume[88540]: .first() Jul 24 12:39:17 devstack cinder-volume[88540]: Jul 24 12:39:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-4c2940bf-b68e-4a26-8b47-d6eba00d2dde req-3bee259c-204a-4c8e-aef7-685a62107e6f tempest-DeleteServersTestJSON-775660950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-4c2940bf-b68e-4a26-8b47-d6eba00d2dde req-3bee259c-204a-4c8e-aef7-685a62107e6f tempest-DeleteServersTestJSON-775660950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-4c2940bf-b68e-4a26-8b47-d6eba00d2dde req-3bee259c-204a-4c8e-aef7-685a62107e6f tempest-DeleteServersTestJSON-775660950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-4c2940bf-b68e-4a26-8b47-d6eba00d2dde req-3bee259c-204a-4c8e-aef7-685a62107e6f tempest-DeleteServersTestJSON-775660950 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-488c9eb6-d256-4aba-b914-98fd26c95837', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '799bc87c-aa55-4d9a-85a8-2eb895ae5a32', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:39:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-4c2940bf-b68e-4a26-8b47-d6eba00d2dde req-3bee259c-204a-4c8e-aef7-685a62107e6f tempest-DeleteServersTestJSON-775660950 None] attachment_update completed successfully. Jul 24 12:39:18 devstack cinder-volume[88540]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 24 12:39:18 devstack cinder-volume[88540]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 12:39:18 devstack cinder-volume[88540]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 24 12:39:18 devstack cinder-volume[88540]: WARNING oslo.privsep.daemon [-] privsep log: Jul 24 12:39:18 devstack cinder-volume[88540]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 24 12:39:18 devstack cinder-volume[88540]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 24 12:39:18 devstack cinder-volume[88540]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 12:39:18 devstack cinder-volume[88540]: WARNING oslo.privsep.daemon [-] privsep log: Jul 24 12:39:18 devstack cinder-volume[88540]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 24 12:39:18 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:18 devstack cinder-volume[88540]: INFO oslo.privsep.daemon [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Spawned new privsep daemon via rootwrap Jul 24 12:39:18 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Accepted privsep connection to /tmp/tmpy41l5wmz/privsep.sock {{(pid=88540) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 24 12:39:18 devstack cinder-volume[88540]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 24 12:39:18 devstack cinder-volume[88540]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 24 12:39:18 devstack cinder-volume[88540]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 24 12:39:18 devstack cinder-volume[88540]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89605 Jul 24 12:39:18 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bf7ddf-2877-4c05-831b-6e3233c2a16b]: (2,) {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:39:19 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec95eac-eb0c-4d5c-b102-799c63a48275]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:39:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:19 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c Jul 24 12:39:19 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:19 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c" returned: 0 in 0.667s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:19 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c Jul 24 12:39:19 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:20 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d10cb58d-d595-4411-a3ad-12dc3b08193c" returned: 0 in 0.511s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Lock "cinder-quobyte-d10cb58d-d595-4411-a3ad-12dc3b08193c" released by "delete_volume" :: held 3.660s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:39:20 devstack cinder-volume[88540]: WARNING cinder.quota [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:39:20 devstack cinder-volume[88540]: WARNING cinder.quota [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:39:20 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Created reservations ['db30da75-14ed-487f-8864-6a0c27ac8854', 'a1ffcc41-0aac-4393-b64d-865e55654076', 'be03a077-c49a-40d0-bd41-01c5482e991c', '7c37f30c-b0fc-4441-9eea-96eed0aa8c1c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:39:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:39:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:39:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:20 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:39:20 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:21 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.597s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:21 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:39:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Deleted volume successfully. Jul 24 12:39:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8d646907-1ac3-4b21-87ed-e8d56faabb6f tempest-VolumesAdminNegativeTest-355384182 None] Lock "cinder-d10cb58d-d595-4411-a3ad-12dc3b08193c-delete_volume" released by "delete_volume" :: held 4.881s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:39:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-240e2dcf-b36f-402b-85be-bc7975d88996 req-f3a915ed-720c-454b-8734-dd5f76175c71 tempest-DeleteServersTestJSON-775660950 None] Terminate volume connection completed successfully. Jul 24 12:39:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-240e2dcf-b36f-402b-85be-bc7975d88996 req-f3a915ed-720c-454b-8734-dd5f76175c71 tempest-DeleteServersTestJSON-775660950 None] Deleting attachment 799bc87c-aa55-4d9a-85a8-2eb895ae5a32. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:39:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Acquiring lock "cinder-488c9eb6-d256-4aba-b914-98fd26c95837-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:39:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Lock "cinder-488c9eb6-d256-4aba-b914-98fd26c95837-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:39:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Acquiring lock "cinder-quobyte-488c9eb6-d256-4aba-b914-98fd26c95837" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:39:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Lock "cinder-quobyte-488c9eb6-d256-4aba-b914-98fd26c95837" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:39:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc972489-d4c2-40a0-a30c-7f255bb73802]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:39:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:28 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837 Jul 24 12:39:28 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:28 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837" returned: 0 in 0.443s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:28 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837 Jul 24 12:39:28 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:29 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-488c9eb6-d256-4aba-b914-98fd26c95837" returned: 0 in 0.290s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Lock "cinder-quobyte-488c9eb6-d256-4aba-b914-98fd26c95837" released by "delete_volume" :: held 0.792s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Created reservations ['812b539e-03f8-4d53-9532-4e0d4bd09523', '041f7bb0-afe0-40b6-84c2-3196d18ce630', 'a3e4c120-126f-4120-9c6d-db25842c4e62', 'a7dc848f-7a7c-4ad0-aef0-fd2d0cdcecc2'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:29 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:39:29 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:29 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.385s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:39:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Deleted volume successfully. Jul 24 12:39:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41879851-ba94-4a0f-a782-59b3a94b0fa8 tempest-DeleteServersTestJSON-775660950 None] Lock "cinder-488c9eb6-d256-4aba-b914-98fd26c95837-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Flow 'volume_create_manager' (0b7101ec-7fe3-4636-bb79-51d8776a8b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3753b7d8-184c-4a5d-a198-12b71d53b8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3753b7d8-184c-4a5d-a198-12b71d53b8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-252983375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c22c46d-f060-4165-a2de-e79ecb60fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2fe42755e480481b72449e360ae2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:39:35Z,use_quota=True,user_id='a9483a83579248149194a2e4b34cb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a189317-fe68-44db-bf71-27efa9dc6420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a189317-fe68-44db-bf71-27efa9dc6420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f067a3-3589-456c-8181-61e2c30354dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45f067a3-3589-456c-8181-61e2c30354dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c22c46d-f060-4165-a2de-e79ecb60fd9c', 'volume_name': 'volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51bd06a2-2cf9-4634-b8c4-7db3b64754b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51bd06a2-2cf9-4634-b8c4-7db3b64754b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa7f1c4-2acc-45f3-9cbd-2120522e8e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:35 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Volume 4c22c46d-f060-4165-a2de-e79ecb60fd9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c', 'volume_size': 1} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-252983375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c22c46d-f060-4165-a2de-e79ecb60fd9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2fe42755e480481b72449e360ae2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:39:35Z,use_quota=True,user_id='a9483a83579248149194a2e4b34cb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Creating volume 4c22c46d-f060-4165-a2de-e79ecb60fd9c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:39:35 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:39:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:35 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c 1073741824 Jul 24 12:39:35 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:36 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c 1073741824" returned: 0 in 0.555s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:36 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c Jul 24 12:39:36 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:36 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c" returned: 0 in 0.341s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:39:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fa7f1c4-2acc-45f3-9cbd-2120522e8e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d93b700-2093-4f23-8a36-05ef3f460b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:39:36 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Volume volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c (4c22c46d-f060-4165-a2de-e79ecb60fd9c): created successfully Jul 24 12:39:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d93b700-2093-4f23-8a36-05ef3f460b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:39:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Flow 'volume_create_manager' (0b7101ec-7fe3-4636-bb79-51d8776a8b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:39:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4c5a9715-7937-46f0-8727-c8eedbc15c97 tempest-AttachVolumeTestJSON-164796843 None] Created volume successfully. Jul 24 12:39:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-04db7176-0891-4198-84ad-b6d1845bae0b req-c3535d37-4c8a-467c-803b-981ff759d07b tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-04db7176-0891-4198-84ad-b6d1845bae0b req-c3535d37-4c8a-467c-803b-981ff759d07b tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-04db7176-0891-4198-84ad-b6d1845bae0b req-c3535d37-4c8a-467c-803b-981ff759d07b tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-04db7176-0891-4198-84ad-b6d1845bae0b req-c3535d37-4c8a-467c-803b-981ff759d07b tempest-AttachVolumeTestJSON-164796843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4a427d5-a2f9-4411-ab11-2c9f3c7386f5', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:39:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-04db7176-0891-4198-84ad-b6d1845bae0b req-c3535d37-4c8a-467c-803b-981ff759d07b tempest-AttachVolumeTestJSON-164796843 None] attachment_update completed successfully. Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:39:42 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:39:42 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:39:42 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.296s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 8 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:39:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:39:49 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=33,cinder:SELECT=27,cinder:INSERT=4 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:39:49 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=33,cinder:INSERT=7,cinder:UPDATE=23,cinder:DELETE=5 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:40:00 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:40:00 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:40:13 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:40:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Flow 'volume_create_manager' (e6d51a05-6cd9-4ad0-8e19-eadd43bba490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:40:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c815a16-4a23-4312-b43d-21e422199d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c815a16-4a23-4312-b43d-21e422199d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2030471679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0988c3cd617d4374b00b722f3bfcbbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:40:14Z,use_quota=True,user_id='2dd9291cbaa947b488fd3f01284509d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94204ee-fb85-4ae2-8bf1-88cfbc5dc62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e94204ee-fb85-4ae2-8bf1-88cfbc5dc62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce74bd9a-1bd1-460f-a60e-3998f3f73b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce74bd9a-1bd1-460f-a60e-3998f3f73b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8', 'volume_name': 'volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1401af57-d581-48c8-84f3-e81fe41025b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1401af57-d581-48c8-84f3-e81fe41025b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52b8957-dfc8-4611-9cac-517e1e38f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:14 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Volume 9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8', 'volume_size': 1} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2030471679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0988c3cd617d4374b00b722f3bfcbbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:40:14Z,use_quota=True,user_id='2dd9291cbaa947b488fd3f01284509d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Creating volume 9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:40:14 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:40:14 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 1073741824 Jul 24 12:40:14 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:40:14 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 1073741824" returned: 0 in 0.631s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:40:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:40:14 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 Jul 24 12:40:14 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:40:15 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Jul 24 12:40:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8" returned: 0 in 0.378s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:40:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:40:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:40:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b52b8957-dfc8-4611-9cac-517e1e38f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3975af3c-cb4a-4b5b-b022-20e4e470b261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:15 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Volume volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 (9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8): created successfully Jul 24 12:40:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3975af3c-cb4a-4b5b-b022-20e4e470b261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Flow 'volume_create_manager' (e6d51a05-6cd9-4ad0-8e19-eadd43bba490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:40:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ceb6d381-1e0b-4947-b2ab-cfa6645f3e59 tempest-AttachVolumeShelveTestJSON-1931328008 None] Created volume successfully. Jul 24 12:40:20 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-36be06b6-0451-47b5-9bd3-a6e1afe745d9 req-2a95e0e5-aa01-4484-90d6-d92593f34406 tempest-AttachVolumeTestJSON-164796843 None] Terminate volume connection completed successfully. Jul 24 12:40:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-36be06b6-0451-47b5-9bd3-a6e1afe745d9 req-2a95e0e5-aa01-4484-90d6-d92593f34406 tempest-AttachVolumeTestJSON-164796843 None] Deleting attachment f4a427d5-a2f9-4411-ab11-2c9f3c7386f5. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Flow 'volume_create_manager' (29b1f902-cc8b-4822-9b27-04a4a1e56aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5368bb-a3c3-48bb-bb62-3ef29de9b01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5368bb-a3c3-48bb-bb62-3ef29de9b01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-467819416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7cd490-5eba-4f35-ba85-0c9f8b05b35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1c75b396264d1391085fcc41352de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:40:28Z,use_quota=True,user_id='5496969f85fc4f1ab55d86225a1d3e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcd35fc-55f8-49e7-a519-84b3587cdee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfcd35fc-55f8-49e7-a519-84b3587cdee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5758516-4ae5-473a-9ad2-ce7a0a370882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5758516-4ae5-473a-9ad2-ce7a0a370882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba7cd490-5eba-4f35-ba85-0c9f8b05b35d', 'volume_name': 'volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abc6d68-9fc8-4a53-aa05-be24ebe4a2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abc6d68-9fc8-4a53-aa05-be24ebe4a2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9bc60e-e499-4b7c-982f-238d96fc8f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:28 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Volume ba7cd490-5eba-4f35-ba85-0c9f8b05b35d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d', 'volume_size': 1} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-467819416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba7cd490-5eba-4f35-ba85-0c9f8b05b35d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d1c75b396264d1391085fcc41352de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:40:28Z,use_quota=True,user_id='5496969f85fc4f1ab55d86225a1d3e1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Creating volume ba7cd490-5eba-4f35-ba85-0c9f8b05b35d {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:40:28 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:40:28 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d 1073741824 Jul 24 12:40:28 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-562ee5cb-5a6a-409f-8965-928bd3ad1597 req-b4b6beb1-0c6b-4838-9342-47e9f96b953d tempest-AttachVolumeShelveTestJSON-1931328008 None] No connector for attachment 702db0a1-102b-482e-a7b6-c7447f9b892b; skipping storage backend terminate_connection call. {{(pid=88540) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 24 12:40:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-562ee5cb-5a6a-409f-8965-928bd3ad1597 req-b4b6beb1-0c6b-4838-9342-47e9f96b953d tempest-AttachVolumeShelveTestJSON-1931328008 None] Deleting attachment 702db0a1-102b-482e-a7b6-c7447f9b892b. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:40:29 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Jul 24 12:40:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d 1073741824" returned: 0 in 0.573s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:40:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:40:29 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d Jul 24 12:40:29 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:40:29 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Jul 24 12:40:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d" returned: 0 in 0.272s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:40:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:40:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:40:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9bc60e-e499-4b7c-982f-238d96fc8f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c582a3f-4fba-4c0b-9ee2-1cf5b01bc513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:29 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Volume volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d (ba7cd490-5eba-4f35-ba85-0c9f8b05b35d): created successfully Jul 24 12:40:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c582a3f-4fba-4c0b-9ee2-1cf5b01bc513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Flow 'volume_create_manager' (29b1f902-cc8b-4822-9b27-04a4a1e56aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:40:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1d116886-6279-4b94-aa08-9027e20682de tempest-TaggedAttachmentsTest-191366833 None] Created volume successfully. Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Flow 'volume_create_manager' (06d88bc8-52b7-4f40-9b31-e911b2b8519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f52e115-9be0-4406-b0f6-7297d95ae79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f52e115-9be0-4406-b0f6-7297d95ae79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1793408357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affc51d2-c2ce-41b6-bb4f-2830e596bc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f451e5b1dde94e1288963968b6dd7203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:40:35Z,use_quota=True,user_id='e60fe33a8fd1413fb8caa6a024e7038e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f6772b-02ca-47f3-a832-1c2084e98839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f6772b-02ca-47f3-a832-1c2084e98839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473ca74e-9e50-4433-9e21-d0b78790e426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (473ca74e-9e50-4433-9e21-d0b78790e426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'affc51d2-c2ce-41b6-bb4f-2830e596bc07', 'volume_name': 'volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553c7a9a-b0ac-46b9-8585-9730abb2c831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553c7a9a-b0ac-46b9-8585-9730abb2c831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e315343-1463-4da4-9854-5a8b3b85b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:34 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Volume affc51d2-c2ce-41b6-bb4f-2830e596bc07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07', 'volume_size': 1} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1793408357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=affc51d2-c2ce-41b6-bb4f-2830e596bc07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f451e5b1dde94e1288963968b6dd7203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:40:35Z,use_quota=True,user_id='e60fe33a8fd1413fb8caa6a024e7038e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Creating volume affc51d2-c2ce-41b6-bb4f-2830e596bc07 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:40:34 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:40:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:40:34 devstack sudo[91684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 1073741824 Jul 24 12:40:34 devstack sudo[91684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:40:35 devstack sudo[91684]: pam_unix(sudo:session): session closed for user root Jul 24 12:40:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 1073741824" returned: 0 in 0.845s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:40:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:40:35 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 Jul 24 12:40:35 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:40:36 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Jul 24 12:40:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07" returned: 0 in 0.633s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:40:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:40:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:40:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e315343-1463-4da4-9854-5a8b3b85b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b51337-5354-4e04-83ca-aa26461ea4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:40:36 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Volume volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 (affc51d2-c2ce-41b6-bb4f-2830e596bc07): created successfully Jul 24 12:40:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b51337-5354-4e04-83ca-aa26461ea4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:40:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Flow 'volume_create_manager' (06d88bc8-52b7-4f40-9b31-e911b2b8519f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:40:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b5e16c36-5009-489e-b436-4d935a351ad6 tempest-ServerActionsTestOtherA-2046582656 None] Created volume successfully. Jul 24 12:40:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:40:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:40:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:40:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:40:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:40:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:40:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:40:42 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:40:42 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:40:42 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Jul 24 12:40:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.804s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:40:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:40:46 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=10,cinder:UPDATE=10 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:40:46 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=3,cinder:SELECT=6 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:41:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-dbdefb4f-402b-4260-9ce7-ef7a4c309dd8 req-0871eb25-aa8c-4a99-933a-ff41afd2fb4d tempest-TaggedAttachmentsTest-191366833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-dbdefb4f-402b-4260-9ce7-ef7a4c309dd8 req-0871eb25-aa8c-4a99-933a-ff41afd2fb4d tempest-TaggedAttachmentsTest-191366833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-dbdefb4f-402b-4260-9ce7-ef7a4c309dd8 req-0871eb25-aa8c-4a99-933a-ff41afd2fb4d tempest-TaggedAttachmentsTest-191366833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-dbdefb4f-402b-4260-9ce7-ef7a4c309dd8 req-0871eb25-aa8c-4a99-933a-ff41afd2fb4d tempest-TaggedAttachmentsTest-191366833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '699e6b53-6beb-462b-a8fa-5acb31d49d16', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:41:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-dbdefb4f-402b-4260-9ce7-ef7a4c309dd8 req-0871eb25-aa8c-4a99-933a-ff41afd2fb4d tempest-TaggedAttachmentsTest-191366833 None] attachment_update completed successfully. Jul 24 12:41:22 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-53ad5d7b-82fa-43f4-8661-d3811643a765 req-5d1e04ca-9f87-4729-ba91-ac72e99ae87e tempest-TaggedAttachmentsTest-191366833 None] Terminate volume connection completed successfully. Jul 24 12:41:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-53ad5d7b-82fa-43f4-8661-d3811643a765 req-5d1e04ca-9f87-4729-ba91-ac72e99ae87e tempest-TaggedAttachmentsTest-191366833 None] Deleting attachment 699e6b53-6beb-462b-a8fa-5acb31d49d16. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:41:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-2180681a-4291-4d2d-bfb2-17dad01a704f req-9d7c0a37-312c-4c8b-a8d5-94c6fc4ff245 tempest-ServerActionsTestOtherA-2046582656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-2180681a-4291-4d2d-bfb2-17dad01a704f req-9d7c0a37-312c-4c8b-a8d5-94c6fc4ff245 tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-2180681a-4291-4d2d-bfb2-17dad01a704f req-9d7c0a37-312c-4c8b-a8d5-94c6fc4ff245 tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-2180681a-4291-4d2d-bfb2-17dad01a704f req-9d7c0a37-312c-4c8b-a8d5-94c6fc4ff245 tempest-ServerActionsTestOtherA-2046582656 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b108341-c597-4f26-8182-b1029a532667', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:41:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-2180681a-4291-4d2d-bfb2-17dad01a704f req-9d7c0a37-312c-4c8b-a8d5-94c6fc4ff245 tempest-ServerActionsTestOtherA-2046582656 None] attachment_update completed successfully. Jul 24 12:41:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-a2fffed8-730a-493c-90e3-e56eef48323c req-190faf01-4ae5-44ca-a9bf-30126ced2ec9 tempest-ServerActionsTestOtherA-2046582656 None] Terminate volume connection completed successfully. Jul 24 12:41:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-a2fffed8-730a-493c-90e3-e56eef48323c req-190faf01-4ae5-44ca-a9bf-30126ced2ec9 tempest-ServerActionsTestOtherA-2046582656 None] Deleting attachment 4b108341-c597-4f26-8182-b1029a532667. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Acquiring lock "cinder-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "cinder-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Acquiring lock "cinder-quobyte-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "cinder-quobyte-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[94df7594-6ef5-42fc-a448-9de582af6ebf]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:31 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 Jul 24 12:41:31 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:31 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8" returned: 0 in 0.486s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-a2fffed8-730a-493c-90e3-e56eef48323c req-6063e582-95c1-481d-a700-0d8d9a8e90a5 tempest-ServerActionsTestOtherA-2046582656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-a2fffed8-730a-493c-90e3-e56eef48323c req-6063e582-95c1-481d-a700-0d8d9a8e90a5 tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-a2fffed8-730a-493c-90e3-e56eef48323c req-6063e582-95c1-481d-a700-0d8d9a8e90a5 tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:31 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8 Jul 24 12:41:31 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-a2fffed8-730a-493c-90e3-e56eef48323c req-6063e582-95c1-481d-a700-0d8d9a8e90a5 tempest-ServerActionsTestOtherA-2046582656 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4b7a219-7063-4f78-a127-84c7bbde182d', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:41:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-a2fffed8-730a-493c-90e3-e56eef48323c req-6063e582-95c1-481d-a700-0d8d9a8e90a5 tempest-ServerActionsTestOtherA-2046582656 None] attachment_update completed successfully. Jul 24 12:41:32 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8" returned: 0 in 0.330s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "cinder-quobyte-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8" released by "delete_volume" :: held 0.898s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Created reservations ['d8eb8fbb-1191-4f2c-b78d-9b8e427eceba', 'b9441e11-b95d-4485-8d01-76ee79eb314e', '276368a5-2293-4633-88a5-dbfe377431c8', '5e2acf4b-7937-47af-9b4d-a76baf0095a4'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:32 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:41:32 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Acquiring lock "cinder-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Lock "cinder-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Acquiring lock "cinder-quobyte-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Lock "cinder-quobyte-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c708325-a6d2-44c3-9129-4044d3e2986c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:32 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.301s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:41:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Deleted volume successfully. Jul 24 12:41:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32203e85-a8d6-4c2d-b1fb-55a483ef193f tempest-AttachVolumeShelveTestJSON-1931328008 None] Lock "cinder-9bdb0bdd-0143-4a96-9bbe-1f7150f3c9c8-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:41:32 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d Jul 24 12:41:32 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:33 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d" returned: 0 in 0.464s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:33 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d Jul 24 12:41:33 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:33 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d" returned: 0 in 0.289s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Lock "cinder-quobyte-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d" released by "delete_volume" :: held 0.830s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Created reservations ['4a76c6a9-95cf-4037-bf8d-fdfe31739210', '064f69fa-54bd-4d34-bf86-5e1a72bdbd35', 'ce73e399-218c-4e56-beb3-74d1a824430f', 'aa991cfb-9b8b-46a8-8b29-8b030221a2e1'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:33 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:41:33 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:34 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.438s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:34 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:41:34 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Deleted volume successfully. Jul 24 12:41:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-db51e009-44f3-48c1-9826-e918d817a2eb tempest-TaggedAttachmentsTest-191366833 None] Lock "cinder-ba7cd490-5eba-4f35-ba85-0c9f8b05b35d-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:42 devstack sudo[93871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:41:42 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:42 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.326s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 8 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:41:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:41:43 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=32,cinder:UPDATE=20,cinder:INSERT=3 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:41:44 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=31,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:41:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c7f96be9-27ef-4883-861b-01e1906b248e tempest-GroupSnapshotsTest-1736545540 None] Group tempest-GroupSnapshotsTest-Group-1462325488: creating Jul 24 12:41:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c7f96be9-27ef-4883-861b-01e1906b248e tempest-GroupSnapshotsTest-1736545540 None] Group tempest-GroupSnapshotsTest-Group-1462325488: created successfully Jul 24 12:41:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c7f96be9-27ef-4883-861b-01e1906b248e tempest-GroupSnapshotsTest-1736545540 None] Create group completed successfully. Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Flow 'volume_create_manager' (1d6918d1-3251-4718-825f-d55b2d8d095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85085ebb-b3c8-4d74-bbd5-21ccbd791a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85085ebb-b3c8-4d74-bbd5-21ccbd791a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1255416383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed41b40b-78a8-41f1-b637-e553ad9f643e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2fe42755e480481b72449e360ae2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:41:49Z,use_quota=True,user_id='a9483a83579248149194a2e4b34cb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbccba3-5a65-4460-9e95-da4522da5407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cbccba3-5a65-4460-9e95-da4522da5407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cab94a-cbeb-4380-98fc-fb2655c8ddca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66cab94a-cbeb-4380-98fc-fb2655c8ddca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed41b40b-78a8-41f1-b637-e553ad9f643e', 'volume_name': 'volume-ed41b40b-78a8-41f1-b637-e553ad9f643e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95410b6-b727-457f-b0c7-f3bbbe7f73ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e95410b6-b727-457f-b0c7-f3bbbe7f73ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba9a23d-b403-4408-91c2-21aac2ac38e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:49 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Volume ed41b40b-78a8-41f1-b637-e553ad9f643e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed41b40b-78a8-41f1-b637-e553ad9f643e', 'volume_size': 1} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1255416383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed41b40b-78a8-41f1-b637-e553ad9f643e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2fe42755e480481b72449e360ae2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:41:49Z,use_quota=True,user_id='a9483a83579248149194a2e4b34cb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Creating volume ed41b40b-78a8-41f1-b637-e553ad9f643e {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:41:49 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:41:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:49 devstack sudo[93928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e 1073741824 Jul 24 12:41:49 devstack sudo[93928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:50 devstack sudo[93928]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e 1073741824" returned: 0 in 0.491s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:50 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e Jul 24 12:41:50 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Flow 'volume_create_manager' (d9084455-7f8d-4288-8955-b4ff697bcc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6664de82-6e1f-434a-a5c7-17a3f66507c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6664de82-6e1f-434a-a5c7-17a3f66507c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-494887418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44340248-58f5-4486-af4a-c180ac9fbc1e,host='devstack@QuobyteHD#QuobyteHD',id=70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e08d5e298f44e43824b644166919c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:41:50Z,use_quota=True,user_id='2f48074acf5545879333d13710ed3bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a334e2-d19d-42fa-bccb-4041cbd87134),volume_type_id=90a334e2-d19d-42fa-bccb-4041cbd87134)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25f1073-35ce-4a16-ba3d-17f4ee32a0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25f1073-35ce-4a16-ba3d-17f4ee32a0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8d3a7b-1f01-4ee4-91db-41bf5d5ac0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8d3a7b-1f01-4ee4-91db-41bf5d5ac0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c', 'volume_name': 'volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4571f4-d8e5-4527-bec0-4110a327de76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4571f4-d8e5-4527-bec0-4110a327de76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a800df58-fdf0-44ca-bb7b-29426e56314e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:50 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Volume 70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c', 'volume_size': 1} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:50 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e" returned: 0 in 0.302s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=44340248-58f5-4486-af4a-c180ac9fbc1e,created_at=2026-07-24T10:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-494887418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=44340248-58f5-4486-af4a-c180ac9fbc1e,host='devstack@QuobyteHD#QuobyteHD',id=70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e08d5e298f44e43824b644166919c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:41:50Z,use_quota=True,user_id='2f48074acf5545879333d13710ed3bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90a334e2-d19d-42fa-bccb-4041cbd87134),volume_type_id=90a334e2-d19d-42fa-bccb-4041cbd87134)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Creating volume 70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:41:50 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba9a23d-b403-4408-91c2-21aac2ac38e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed41b40b-78a8-41f1-b637-e553ad9f643e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2515773-0e0c-4f6c-802d-e7f365f772a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:50 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c 1073741824 Jul 24 12:41:50 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:50 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Volume volume-ed41b40b-78a8-41f1-b637-e553ad9f643e (ed41b40b-78a8-41f1-b637-e553ad9f643e): created successfully Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2515773-0e0c-4f6c-802d-e7f365f772a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Flow 'volume_create_manager' (1d6918d1-3251-4718-825f-d55b2d8d095a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:41:50 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2cff32e3-e16e-4a43-be60-3b92dc6fff04 tempest-AttachVolumeTestJSON-164796843 None] Created volume successfully. Jul 24 12:41:50 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c 1073741824" returned: 0 in 0.438s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:50 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c Jul 24 12:41:51 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:51 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a800df58-fdf0-44ca-bb7b-29426e56314e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed3df82-c5b5-423b-86b7-203f93d09e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:51 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Volume volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c (70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c): created successfully Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed3df82-c5b5-423b-86b7-203f93d09e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Flow 'volume_create_manager' (d9084455-7f8d-4288-8955-b4ff697bcc06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:41:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5748c32a-f563-476c-957a-f14b4548e627 tempest-GroupSnapshotsTest-1736545540 None] Created volume successfully. Jul 24 12:41:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] GroupSnapshot 5c513521-25b6-4cb3-91fa-6a45302b8aff: creating. Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Group snapshot 5c513521-25b6-4cb3-91fa-6a45302b8aff: creating. {{(pid=88540) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Creating offline snapshot 27e41d32-0e0e-406c-b428-ec3f16d35458 of volume 70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:41:52 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5ced70-b4f7-48bc-8dd9-492bedbecaf5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:41:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:52 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c Jul 24 12:41:52 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:52 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" returned: 0 in 0.525s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:52 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 1G Jul 24 12:41:52 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-16c35b11-eaf6-4ad1-8b4a-2a59f9259c4c req-f4ed9f45-6794-4a26-942a-9cca13ed47c1 tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:52 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 1G" returned: 0 in 0.426s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:52 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 Jul 24 12:41:52 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:53 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458" returned: 0 in 0.311s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:53 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:41:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:53 devstack sudo[93976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 Jul 24 12:41:53 devstack sudo[93976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:53 devstack sudo[93976]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:53 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.info Jul 24 12:41:53 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:53 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.info" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:53 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:41:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:53 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.info Jul 24 12:41:53 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:54 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.info" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-16c35b11-eaf6-4ad1-8b4a-2a59f9259c4c req-f4ed9f45-6794-4a26-942a-9cca13ed47c1 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.547s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-16c35b11-eaf6-4ad1-8b4a-2a59f9259c4c req-f4ed9f45-6794-4a26-942a-9cca13ed47c1 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.107s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-16c35b11-eaf6-4ad1-8b4a-2a59f9259c4c req-f4ed9f45-6794-4a26-942a-9cca13ed47c1 tempest-AttachVolumeTestJSON-164796843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-ed41b40b-78a8-41f1-b637-e553ad9f643e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc2ae175-7f72-48c3-8cbc-d9ace57d0929', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:41:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e7541088-7473-46eb-939f-195eee4c148c tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 5c513521-25b6-4cb3-91fa-6a45302b8aff: created successfully Jul 24 12:41:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-16c35b11-eaf6-4ad1-8b4a-2a59f9259c4c req-f4ed9f45-6794-4a26-942a-9cca13ed47c1 tempest-AttachVolumeTestJSON-164796843 None] attachment_update completed successfully. Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-27e41d32-0e0e-406c-b428-ec3f16d35458-d867127f-46c3-4f9c-99e5-23bb606c7fcb" by "_create_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-27e41d32-0e0e-406c-b428-ec3f16d35458-d867127f-46c3-4f9c-99e5-23bb606c7fcb" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Creating volume d867127f-46c3-4f9c-99e5-23bb606c7fcb from snapshot 27e41d32-0e0e-406c-b428-ec3f16d35458 {{(pid=88540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-d867127f-46c3-4f9c-99e5-23bb606c7fcb" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-d867127f-46c3-4f9c-99e5-23bb606c7fcb" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] snapshot: 27e41d32-0e0e-406c-b428-ec3f16d35458, volume: d867127f-46c3-4f9c-99e5-23bb606c7fcb, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a6f16-1fe1-4a6c-8e24-3a90c169a004]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:41:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:56 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 Jul 24 12:41:56 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Flow 'volume_create_manager' (6c3a4039-9459-42ad-bd82-3bf660a830c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a933b108-9945-46dc-a00e-2d91b716da54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:56 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458" returned: 0 in 0.684s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a933b108-9945-46dc-a00e-2d91b716da54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-629427003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58ae038-2e8c-4b04-9ce1-894fe1245912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2fe42755e480481b72449e360ae2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:41:57Z,use_quota=True,user_id='a9483a83579248149194a2e4b34cb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8999ff8-3ffa-4d8a-8ccb-c7e1e043144c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8999ff8-3ffa-4d8a-8ccb-c7e1e043144c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e32a567-bf78-444b-b962-f3491dc0d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e32a567-bf78-444b-b962-f3491dc0d49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a58ae038-2e8c-4b04-9ce1-894fe1245912', 'volume_name': 'volume-a58ae038-2e8c-4b04-9ce1-894fe1245912', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb9c749-9913-427e-b7c6-2aadec21105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb9c749-9913-427e-b7c6-2aadec21105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200a83da-8e6d-4093-ad8d-13cb18f4d82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:41:56 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Volume a58ae038-2e8c-4b04-9ce1-894fe1245912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a58ae038-2e8c-4b04-9ce1-894fe1245912', 'volume_size': 1} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9489f37d-83f0-4bf6-be15-1295df639c23]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:41:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:56 devstack sudo[94020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c Jul 24 12:41:56 devstack sudo[94020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:41:57 devstack sudo[94020]: pam_unix(sudo:session): session closed for user root Jul 24 12:41:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" returned: 0 in 0.409s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:41:57 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:41:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:41:57 devstack sudo[94026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb Jul 24 12:41:57 devstack sudo[94026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:02 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-c905799c-8aa4-4ce0-abf0-17272dd3478d req-565670ab-4739-4c8b-8c3e-59374066439e tempest-ServerActionsTestOtherA-2046582656 None] Terminate volume connection completed successfully. Jul 24 12:42:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-c905799c-8aa4-4ce0-abf0-17272dd3478d req-565670ab-4739-4c8b-8c3e-59374066439e tempest-ServerActionsTestOtherA-2046582656 None] Deleting attachment d4b7a219-7063-4f78-a127-84c7bbde182d. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:42:03 devstack sudo[94026]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb" returned: 0 in 6.018s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:03 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f603a09c-99ab-4916-8218-11d624f030ed]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:03 devstack sudo[94068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c Jul 24 12:42:03 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:03 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" returned: 0 in 0.615s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:03 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:42:03 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Converted 1024.00 MB image at 170.12 MB/s Jul 24 12:42:03 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:42:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:03 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb Jul 24 12:42:03 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:04 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb" returned: 0 in 0.312s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-d867127f-46c3-4f9c-99e5-23bb606c7fcb" released by "_copy_volume_from_snapshot" :: held 8.206s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-27e41d32-0e0e-406c-b428-ec3f16d35458-d867127f-46c3-4f9c-99e5-23bb606c7fcb" released by "_create_volume_from_snapshot" :: held 8.257s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.286s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.412s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-629427003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a58ae038-2e8c-4b04-9ce1-894fe1245912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16c2fe42755e480481b72449e360ae2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:41:57Z,use_quota=True,user_id='a9483a83579248149194a2e4b34cb4a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Creating volume a58ae038-2e8c-4b04-9ce1-894fe1245912 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:42:04 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:04 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 1073741824 Jul 24 12:42:04 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:04 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-33f4c82c-6ac8-48b3-8e73-98b0acace5c5 tempest-GroupSnapshotsTest-1736545540 None] Create group from source-snapshot-5c513521-25b6-4cb3-91fa-6a45302b8aff completed successfully. Jul 24 12:42:04 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 1073741824" returned: 0 in 0.794s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:05 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 Jul 24 12:42:05 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:05 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912" returned: 0 in 0.417s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:42:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (200a83da-8e6d-4093-ad8d-13cb18f4d82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a58ae038-2e8c-4b04-9ce1-894fe1245912', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6daaaae4-1d44-4408-ae4c-c3bded0568e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:05 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Volume volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 (a58ae038-2e8c-4b04-9ce1-894fe1245912): created successfully Jul 24 12:42:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6daaaae4-1d44-4408-ae4c-c3bded0568e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Flow 'volume_create_manager' (6c3a4039-9459-42ad-bd82-3bf660a830c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:05 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f8ef912d-e4e8-4b7a-8c56-4fd48b591a7f tempest-AttachVolumeTestJSON-164796843 None] Created volume successfully. Jul 24 12:42:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-d867127f-46c3-4f9c-99e5-23bb606c7fcb" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-d867127f-46c3-4f9c-99e5-23bb606c7fcb" acquired by "delete_volume" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:06 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[28afb027-94ab-4627-863a-b267e5a85dff]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:06 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb Jul 24 12:42:06 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:07 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb" returned: 0 in 0.490s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:07 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb Jul 24 12:42:07 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-743f18f3-1d5d-44d5-a700-4f945f6ad449 req-ab0b4480-a987-4b55-b358-a01e58c37d09 tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-743f18f3-1d5d-44d5-a700-4f945f6ad449 req-ab0b4480-a987-4b55-b358-a01e58c37d09 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-743f18f3-1d5d-44d5-a700-4f945f6ad449 req-ab0b4480-a987-4b55-b358-a01e58c37d09 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-743f18f3-1d5d-44d5-a700-4f945f6ad449 req-ab0b4480-a987-4b55-b358-a01e58c37d09 tempest-AttachVolumeTestJSON-164796843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-a58ae038-2e8c-4b04-9ce1-894fe1245912', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1100ee86-d26f-45ec-9461-8bdc14ef0926', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:42:07 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-743f18f3-1d5d-44d5-a700-4f945f6ad449 req-ab0b4480-a987-4b55-b358-a01e58c37d09 tempest-AttachVolumeTestJSON-164796843 None] attachment_update completed successfully. Jul 24 12:42:07 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d867127f-46c3-4f9c-99e5-23bb606c7fcb" returned: 0 in 0.307s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-d867127f-46c3-4f9c-99e5-23bb606c7fcb" released by "delete_volume" :: held 0.869s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['e2aaf476-611b-4ee8-b32b-3102002e7e6c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:07 devstack cinder-volume[88540]: WARNING cinder.quota [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1786902812 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1786902812, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:42:07 devstack cinder-volume[88540]: WARNING cinder.quota [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1786902812 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1786902812, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['b54dbf90-4e6d-4647-a3e8-88d765e1c597', '764c4969-5b35-41d4-99da-0c2a1983dff3', '97067ad6-5eff-4e71-b3a1-055f532a5d3a', '17240c56-a4ec-43a5-90e9-5895ae50ea26'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:07 devstack sudo[94166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:07 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:08 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.382s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c916fc4d-d156-41a4-b34a-fd687beb88da tempest-GroupSnapshotsTest-1736545540 None] Delete group completed successfully. Jul 24 12:42:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 5c513521-25b6-4cb3-91fa-6a45302b8aff: deleting Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 5c513521-25b6-4cb3-91fa-6a45302b8aff: deleting {{(pid=88540) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-27e41d32-0e0e-406c-b428-ec3f16d35458" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-27e41d32-0e0e-406c-b428-ec3f16d35458" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Deleting offline snapshot 27e41d32-0e0e-406c-b428-ec3f16d35458 of volume 70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] snapshot_file for this snap is: volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9378d580-5d5a-47c8-b877-3fb72370b45d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:08 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 Jul 24 12:42:08 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:08 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458" returned: 0 in 0.452s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Acquiring lock "cinder-affc51d2-c2ce-41b6-bb4f-2830e596bc07-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bfa4d4-3708-47e0-906b-3596d5d314b4]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Lock "cinder-affc51d2-c2ce-41b6-bb4f-2830e596bc07-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Acquiring lock "cinder-quobyte-affc51d2-c2ce-41b6-bb4f-2830e596bc07" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Lock "cinder-quobyte-affc51d2-c2ce-41b6-bb4f-2830e596bc07" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcde13c9-8a1b-42b7-8d05-e1429da4da55]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:09 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c Jul 24 12:42:09 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:09 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 Jul 24 12:42:09 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:09 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" returned: 0 in 0.700s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:09 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 Jul 24 12:42:09 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:09 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07" returned: 0 in 0.806s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:09 devstack sudo[94243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07 Jul 24 12:42:09 devstack sudo[94243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:10 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458" returned: 0 in 0.709s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:10 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458 Jul 24 12:42:10 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:10 devstack sudo[94243]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-affc51d2-c2ce-41b6-bb4f-2830e596bc07" returned: 0 in 0.411s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Lock "cinder-quobyte-affc51d2-c2ce-41b6-bb4f-2830e596bc07" released by "delete_volume" :: held 1.306s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Created reservations ['fae7cca6-37a4-44b8-a069-b9a7954c56c1', 'd35a2c3f-86d5-4804-b81b-4d1974264c48', 'fd160ae9-30c5-4ca5-a61b-415a646c9eac', 'e3e0d825-855b-406f-8765-4c3d6a168ca3'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:10 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:10 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:10 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c.27e41d32-0e0e-406c-b428-ec3f16d35458" returned: 0 in 0.333s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-27e41d32-0e0e-406c-b428-ec3f16d35458" released by "_delete_snapshot" :: held 2.351s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" released by "delete_snapshot" :: held 2.395s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:10 devstack cinder-volume[88540]: WARNING cinder.quota [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1786902812 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1786902812, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['95bf874d-a43b-46eb-b119-3cae1cce980f', 'ca940883-bdb9-4402-abb6-7323e421c695', '39a3158f-b151-4622-9e8b-bfb339de9590', 'caa1acf0-c90b-4826-84e4-849b314dbc0d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8054a82e-1c2b-43d5-8afc-97e7da752b35 tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 5c513521-25b6-4cb3-91fa-6a45302b8aff: deleted successfully Jul 24 12:42:10 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.276s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Deleted volume successfully. Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-908a0d65-162d-4919-a6c3-fdffd39ff37b tempest-ServerActionsTestOtherA-2046582656 None] Lock "cinder-affc51d2-c2ce-41b6-bb4f-2830e596bc07-delete_volume" released by "delete_volume" :: held 1.983s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-c6fc62d6-0d55-47fc-8ab3-03e45362c3b0 req-2fd64511-97a3-4bb4-bf37-1f50526fec01 tempest-AttachVolumeTestJSON-164796843 None] Terminate volume connection completed successfully. Jul 24 12:42:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-c6fc62d6-0d55-47fc-8ab3-03e45362c3b0 req-2fd64511-97a3-4bb4-bf37-1f50526fec01 tempest-AttachVolumeTestJSON-164796843 None] Deleting attachment dc2ae175-7f72-48c3-8cbc-d9ace57d0929. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:42:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:12 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8802d9c6-9da7-4771-b230-a1db4e32b43e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:12 devstack sudo[94303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c Jul 24 12:42:12 devstack sudo[94303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:13 devstack sudo[94303]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" returned: 0 in 1.040s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:13 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c Jul 24 12:42:13 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-2f12378f-8e52-4a06-aef4-fef483bef4e6 req-7785c106-0852-4ada-97c6-d7a0360da358 tempest-AttachVolumeTestJSON-164796843 None] Terminate volume connection completed successfully. Jul 24 12:42:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-2f12378f-8e52-4a06-aef4-fef483bef4e6 req-7785c106-0852-4ada-97c6-d7a0360da358 tempest-AttachVolumeTestJSON-164796843 None] Deleting attachment 1100ee86-d26f-45ec-9461-8bdc14ef0926. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:42:13 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" returned: 0 in 0.611s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-70e28e86-03b9-4c6d-8a30-4f2ba1e61b4c" released by "delete_volume" :: held 1.758s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:13 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['bbf243e1-6e5f-4cf5-bf2d-f24cafd84a09'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:13 devstack cinder-volume[88540]: WARNING cinder.db.api [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1786902812'] Jul 24 12:42:13 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['8f974eba-49dd-4f58-9a77-7be23402dab9', '2a2d38ce-35e8-40af-be68-07a71cab867a', '539b306d-ca56-4b1d-b47b-ee28b8326d84', 'b9dc06e3-7901-40c9-b69e-de94558d5db4'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:14 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:14 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:14 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.454s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:14 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9f210344-1474-467e-b575-07b234298042 tempest-GroupSnapshotsTest-1736545540 None] Delete group completed successfully. Jul 24 12:42:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6e94711c-4bb5-466a-9d18-c9da046e61da tempest-GroupSnapshotsTest-1736545540 None] Group tempest-GroupSnapshotsTest-Group-626552619: creating Jul 24 12:42:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6e94711c-4bb5-466a-9d18-c9da046e61da tempest-GroupSnapshotsTest-1736545540 None] Group tempest-GroupSnapshotsTest-Group-626552619: created successfully Jul 24 12:42:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6e94711c-4bb5-466a-9d18-c9da046e61da tempest-GroupSnapshotsTest-1736545540 None] Create group completed successfully. Jul 24 12:42:17 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:42:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Flow 'volume_create_manager' (e864a867-c73a-4488-a18a-afa831542af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964a6abe-6ce3-46e6-bbc8-6e82e3290f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964a6abe-6ce3-46e6-bbc8-6e82e3290f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1332525675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c55408d-9706-4cb6-b6b7-8c0324120105,host='devstack@QuobyteHD#QuobyteHD',id=9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e08d5e298f44e43824b644166919c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:18Z,use_quota=True,user_id='2f48074acf5545879333d13710ed3bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c214bf8f-57c4-4c4f-8333-3c2d4816a675),volume_type_id=c214bf8f-57c4-4c4f-8333-3c2d4816a675)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619313ee-98b6-4067-a727-f682e6f63e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (619313ee-98b6-4067-a727-f682e6f63e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de97329b-db6b-42e1-9220-b471b8090fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de97329b-db6b-42e1-9220-b471b8090fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5', 'volume_name': 'volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450675a8-f806-45b7-ad02-24768eee25c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450675a8-f806-45b7-ad02-24768eee25c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3ce86f-8e81-47e1-b67e-8887f18bf411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:18 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Volume 9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5', 'volume_size': 1} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c55408d-9706-4cb6-b6b7-8c0324120105,created_at=2026-07-24T10:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1332525675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c55408d-9706-4cb6-b6b7-8c0324120105,host='devstack@QuobyteHD#QuobyteHD',id=9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e08d5e298f44e43824b644166919c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:18Z,use_quota=True,user_id='2f48074acf5545879333d13710ed3bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c214bf8f-57c4-4c4f-8333-3c2d4816a675),volume_type_id=c214bf8f-57c4-4c4f-8333-3c2d4816a675)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Creating volume 9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:42:18 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:18 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 1073741824 Jul 24 12:42:18 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:18 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 1073741824" returned: 0 in 0.677s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:18 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 Jul 24 12:42:18 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:19 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" returned: 0 in 0.515s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:42:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd3ce86f-8e81-47e1-b67e-8887f18bf411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acee2ba3-3497-47e0-b131-11b2bd2138c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Volume volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 (9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5): created successfully Jul 24 12:42:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acee2ba3-3497-47e0-b131-11b2bd2138c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Flow 'volume_create_manager' (e864a867-c73a-4488-a18a-afa831542af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e3b8b653-ab43-438e-b5c3-9177ff3761b8 tempest-GroupSnapshotsTest-1736545540 None] Created volume successfully. Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Flow 'volume_create_manager' (df9aac2f-8fac-454c-b587-78c2d030db56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce46732-ece8-4548-acd8-ed5043a731c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce46732-ece8-4548-acd8-ed5043a731c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-914878264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c55408d-9706-4cb6-b6b7-8c0324120105,host='devstack@QuobyteHD#QuobyteHD',id=b60c9241-ee0c-435b-9589-1eb0c77fbdaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e08d5e298f44e43824b644166919c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:22Z,use_quota=True,user_id='2f48074acf5545879333d13710ed3bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c214bf8f-57c4-4c4f-8333-3c2d4816a675),volume_type_id=c214bf8f-57c4-4c4f-8333-3c2d4816a675)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97d4848-bdc8-4c7d-843c-01460ac15517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97d4848-bdc8-4c7d-843c-01460ac15517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722bd1dc-d4f9-4004-b06d-8539ebda193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (722bd1dc-d4f9-4004-b06d-8539ebda193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b60c9241-ee0c-435b-9589-1eb0c77fbdaf', 'volume_name': 'volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f148d8-f5c5-49cd-8393-bfba19ed5160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70f148d8-f5c5-49cd-8393-bfba19ed5160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6364c340-0a92-43a6-8d75-b27af02994d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:21 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Volume b60c9241-ee0c-435b-9589-1eb0c77fbdaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf', 'volume_size': 1} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c55408d-9706-4cb6-b6b7-8c0324120105,created_at=2026-07-24T10:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-914878264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c55408d-9706-4cb6-b6b7-8c0324120105,host='devstack@QuobyteHD#QuobyteHD',id=b60c9241-ee0c-435b-9589-1eb0c77fbdaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e08d5e298f44e43824b644166919c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:22Z,use_quota=True,user_id='2f48074acf5545879333d13710ed3bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c214bf8f-57c4-4c4f-8333-3c2d4816a675),volume_type_id=c214bf8f-57c4-4c4f-8333-3c2d4816a675)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Creating volume b60c9241-ee0c-435b-9589-1eb0c77fbdaf {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:42:21 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:42:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:22 devstack sudo[94400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf 1073741824 Jul 24 12:42:22 devstack sudo[94400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:22 devstack sudo[94400]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf 1073741824" returned: 0 in 0.599s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:22 devstack sudo[94407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf Jul 24 12:42:22 devstack sudo[94407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:22 devstack sudo[94407]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "cinder-a58ae038-2e8c-4b04-9ce1-894fe1245912-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" returned: 0 in 0.390s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6364c340-0a92-43a6-8d75-b27af02994d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e304039-abb1-4724-96b5-b8a340409a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-a58ae038-2e8c-4b04-9ce1-894fe1245912-delete_volume" acquired by "delete_volume" :: waited 0.116s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Volume volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf (b60c9241-ee0c-435b-9589-1eb0c77fbdaf): created successfully Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e304039-abb1-4724-96b5-b8a340409a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Flow 'volume_create_manager' (df9aac2f-8fac-454c-b587-78c2d030db56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cb8a85a2-1afd-4993-acf1-a288bad25846 tempest-GroupSnapshotsTest-1736545540 None] Created volume successfully. Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "cinder-quobyte-a58ae038-2e8c-4b04-9ce1-894fe1245912" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-quobyte-a58ae038-2e8c-4b04-9ce1-894fe1245912" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a420997d-227c-4d9f-868a-4b23db4f043e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:23 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 Jul 24 12:42:23 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912" returned: 0 in 0.622s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:23 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:23 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912 Jul 24 12:42:23 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:24 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a58ae038-2e8c-4b04-9ce1-894fe1245912" returned: 0 in 0.584s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-quobyte-a58ae038-2e8c-4b04-9ce1-894fe1245912" released by "delete_volume" :: held 1.298s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:24 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Created reservations ['9e1fabb1-6b91-4a0d-af12-6a3091d412a0', '372135c6-84b9-4b41-b63b-e9a14d9324cd', '414a59a3-d827-48e1-aa1f-67af2de41045', 'f208adf8-ba8b-4254-b37c-4bd88065f48c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:24 devstack sudo[94462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:24 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-243029ef-f04a-47e3-a7f2-48659d831299 tempest-GroupSnapshotsTest-1736545540 None] Update group completed successfully. Jul 24 12:42:25 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.458s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:25 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Deleted volume successfully. Jul 24 12:42:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "cinder-ed41b40b-78a8-41f1-b637-e553ad9f643e-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-ed41b40b-78a8-41f1-b637-e553ad9f643e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e3a4b8a4-abde-4e42-a671-942c76c1947f tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-a58ae038-2e8c-4b04-9ce1-894fe1245912-delete_volume" released by "delete_volume" :: held 2.353s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "cinder-quobyte-ed41b40b-78a8-41f1-b637-e553ad9f643e" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-quobyte-ed41b40b-78a8-41f1-b637-e553ad9f643e" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6fff27-49af-4a9e-bc12-a8e2b8578953]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:25 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e Jul 24 12:42:25 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:26 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e" returned: 0 in 0.472s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:26 devstack sudo[94499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e Jul 24 12:42:26 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-023281fe-16c4-4bf5-887a-de0064c88c0f tempest-GroupSnapshotsTest-1736545540 None] Update group completed successfully. Jul 24 12:42:26 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ed41b40b-78a8-41f1-b637-e553ad9f643e" returned: 0 in 0.500s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-quobyte-ed41b40b-78a8-41f1-b637-e553ad9f643e" released by "delete_volume" :: held 1.033s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Created reservations ['ec55ce53-5232-4d6a-9676-d967939ba8c0', 'f7f4e6fc-bbd1-439c-8d6f-46ad137bfb4c', '27876d1d-0f95-4f5f-84eb-6b1ac66ec090', '7179c6c2-fc4c-4b1b-b30a-343444fa634c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:26 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:26 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:27 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.362s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:27 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Deleted volume successfully. Jul 24 12:42:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-765f587b-4b74-47f3-baf5-4289d77034ee tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-ed41b40b-78a8-41f1-b637-e553ad9f643e-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9387d9dc-6102-4930-8b54-aa41973be237 tempest-GroupSnapshotsTest-1736545540 None] Update group completed successfully. Jul 24 12:42:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "cinder-4c22c46d-f060-4165-a2de-e79ecb60fd9c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-4c22c46d-f060-4165-a2de-e79ecb60fd9c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "cinder-quobyte-4c22c46d-f060-4165-a2de-e79ecb60fd9c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-quobyte-4c22c46d-f060-4165-a2de-e79ecb60fd9c" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8e7464-41b4-46cd-b0ce-6b662feb11b0]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:28 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c Jul 24 12:42:28 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:28 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c" returned: 0 in 0.459s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:28 devstack sudo[94514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c Jul 24 12:42:28 devstack sudo[94514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-49b36768-0c0e-4f68-93fa-418c58dbcebd tempest-GroupSnapshotsTest-1736545540 None] Update group completed successfully. Jul 24 12:42:28 devstack sudo[94514]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4c22c46d-f060-4165-a2de-e79ecb60fd9c" returned: 0 in 0.388s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-quobyte-4c22c46d-f060-4165-a2de-e79ecb60fd9c" released by "delete_volume" :: held 0.910s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:28 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Created reservations ['e7e5baf1-a4cf-47dd-9bd8-6fd940036a0e', 'da6dc658-d8df-4bf9-8871-a5f8fff417cf', 'dd6cfa7b-68f8-4874-909f-48ca22613798', '72ca44df-81f2-4320-9b35-e167add52edf'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:29 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:29 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:29 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.350s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:29 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Deleted volume successfully. Jul 24 12:42:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-437835ce-d764-4cf9-bf83-f115f0bc5701 tempest-AttachVolumeTestJSON-164796843 None] Lock "cinder-4c22c46d-f060-4165-a2de-e79ecb60fd9c-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] GroupSnapshot 305eb593-d6c8-4ceb-9a34-022739706b75: creating. Jul 24 12:42:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Group snapshot 305eb593-d6c8-4ceb-9a34-022739706b75: creating. {{(pid=88540) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 12:42:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Creating offline snapshot 73275714-1a3f-4441-8933-6a051dc710ea of volume 9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:42:30 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[611cb022-6730-49ec-8a3a-375a8ec8d78d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:30 devstack sudo[94550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 Jul 24 12:42:30 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:30 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" returned: 0 in 0.401s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:30 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea 1G Jul 24 12:42:30 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:31 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea 1G" returned: 0 in 0.484s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:31 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea Jul 24 12:42:31 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:31 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea" returned: 0 in 0.328s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:31 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:42:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:31 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea Jul 24 12:42:31 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:31 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea" returned: 0 in 0.253s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:32 devstack sudo[94570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.info Jul 24 12:42:32 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:32 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.info" returned: 0 in 0.362s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:32 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:32 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.info Jul 24 12:42:32 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:32 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.info" returned: 0 in 0.315s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.266s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Creating offline snapshot c36f845b-4087-4952-910e-d848b30638c1 of volume b60c9241-ee0c-435b-9589-1eb0c77fbdaf {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8191b75-edd1-4833-b37d-606789e16d69]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:32 devstack sudo[94577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf Jul 24 12:42:32 devstack sudo[94577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:33 devstack sudo[94577]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" returned: 0 in 0.464s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:33 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 1G Jul 24 12:42:33 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:33 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 1G" returned: 0 in 0.618s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:33 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 Jul 24 12:42:33 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:34 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1" returned: 0 in 0.577s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:34 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:42:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:34 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 Jul 24 12:42:34 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:34 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1" returned: 0 in 0.325s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:34 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:42:34 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.info Jul 24 12:42:34 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Flow 'volume_create_manager' (2ab02ada-f8d9-4a01-a1e9-67d59f81e37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece63645-8d9c-44d9-96e7-02c85f2b32a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ece63645-8d9c-44d9-96e7-02c85f2b32a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1873972077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04bdf35d-e707-4709-ab3e-1d31a2ce3b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6ff3fb303465a8b38d4769b43de8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:35Z,use_quota=True,user_id='eb324b51c00245eeb8b8168db5c1f34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf40c7d3-d15a-4484-b2db-cb1b48e3864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf40c7d3-d15a-4484-b2db-cb1b48e3864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34020df-b78b-49d6-983d-d5233e2cead2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a34020df-b78b-49d6-983d-d5233e2cead2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04bdf35d-e707-4709-ab3e-1d31a2ce3b75', 'volume_name': 'volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7435da90-aee8-485b-8fca-4b21981144f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7435da90-aee8-485b-8fca-4b21981144f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33abc22e-969b-4bad-bc8d-aeb17399e278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:35 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Volume 04bdf35d-e707-4709-ab3e-1d31a2ce3b75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75', 'volume_size': 1} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:35 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.info" returned: 0 in 0.428s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:35 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:35 devstack sudo[94601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.info Jul 24 12:42:35 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:35 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.info" returned: 0 in 0.293s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.823s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1873972077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04bdf35d-e707-4709-ab3e-1d31a2ce3b75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6ff3fb303465a8b38d4769b43de8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:35Z,use_quota=True,user_id='eb324b51c00245eeb8b8168db5c1f34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Creating volume 04bdf35d-e707-4709-ab3e-1d31a2ce3b75 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:42:35 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:35 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 1073741824 Jul 24 12:42:35 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:35 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4293776e-4942-4c7f-a703-6594c21630b4 tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 305eb593-d6c8-4ceb-9a34-022739706b75: created successfully Jul 24 12:42:35 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 305eb593-d6c8-4ceb-9a34-022739706b75: deleting Jul 24 12:42:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 305eb593-d6c8-4ceb-9a34-022739706b75: deleting {{(pid=88540) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-73275714-1a3f-4441-8933-6a051dc710ea" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-73275714-1a3f-4441-8933-6a051dc710ea" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Deleting offline snapshot 73275714-1a3f-4441-8933-6a051dc710ea of volume 9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] snapshot_file for this snap is: volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b8995f-34a6-470d-9443-dacd75ebe8dd]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:36 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 1073741824" returned: 0 in 0.709s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:36 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea Jul 24 12:42:36 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:36 devstack sudo[94614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 Jul 24 12:42:36 devstack sudo[94614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:36 devstack sudo[94614]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75" returned: 0 in 0.361s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:36 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea" returned: 0 in 0.629s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33abc22e-969b-4bad-bc8d-aeb17399e278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1a2012-8e59-403a-a952-63b82f16a138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d127a2-6d1d-4a08-91a0-f06e0b133cb7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:36 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Volume volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 (04bdf35d-e707-4709-ab3e-1d31a2ce3b75): created successfully Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b1a2012-8e59-403a-a952-63b82f16a138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Flow 'volume_create_manager' (2ab02ada-f8d9-4a01-a1e9-67d59f81e37d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-be21e58f-82a6-4c00-a0d7-7a7f95bf27d2 tempest-ServersNegativeTestJSON-2077195044 None] Created volume successfully. Jul 24 12:42:36 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 Jul 24 12:42:36 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:37 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" returned: 0 in 0.417s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:37 devstack sudo[94626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea Jul 24 12:42:37 devstack sudo[94626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:37 devstack sudo[94626]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea" returned: 0 in 0.467s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:37 devstack sudo[94632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea Jul 24 12:42:37 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:38 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5.73275714-1a3f-4441-8933-6a051dc710ea" returned: 0 in 0.360s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-73275714-1a3f-4441-8933-6a051dc710ea" released by "_delete_snapshot" :: held 2.027s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" released by "delete_snapshot" :: held 2.063s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-c36f845b-4087-4952-910e-d848b30638c1" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-c36f845b-4087-4952-910e-d848b30638c1" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Deleting offline snapshot c36f845b-4087-4952-910e-d848b30638c1 of volume b60c9241-ee0c-435b-9589-1eb0c77fbdaf {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] snapshot_file for this snap is: volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bb5f42-97b4-41dc-91a3-945999266c57]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:38 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 Jul 24 12:42:38 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:38 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1" returned: 0 in 0.527s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a882746f-b984-4927-8a40-8d4e30ad3b70]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:39 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf Jul 24 12:42:39 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:39 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" returned: 0 in 0.456s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:39 devstack sudo[94647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 Jul 24 12:42:39 devstack sudo[94647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:39 devstack sudo[94647]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1" returned: 0 in 0.392s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:39 devstack sudo[94652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1 Jul 24 12:42:39 devstack sudo[94652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:40 devstack sudo[94652]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf.c36f845b-4087-4952-910e-d848b30638c1" returned: 0 in 0.312s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-c36f845b-4087-4952-910e-d848b30638c1" released by "_delete_snapshot" :: held 1.903s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" released by "delete_snapshot" :: held 1.975s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:40 devstack cinder-volume[88540]: WARNING cinder.quota [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1766351852 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1766351852, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:42:40 devstack cinder-volume[88540]: WARNING cinder.quota [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1766351852 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1766351852, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:42:40 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['39737cde-9541-46e9-989b-fb553ec3114a', '076d714b-9fec-4ffe-b841-5e5a9359eb2c', '9d39ade6-fa82-49e0-94c0-1404b4fe8c66', 'bfee7a49-ac5a-495a-9f6d-c9d9fdd0c45b'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:40 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['d5997a75-9695-4fb3-bd0b-c8812d5730bc', 'f682426e-167c-497e-9095-8da89a41ab84', '8ffbe532-d715-4908-80b4-dc5e56cff70b', 'c353d060-796b-4ee6-a6e1-75c6a97c6893'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:40 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f60125f9-1c45-4193-b0fe-d5e4c9eb416e tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 305eb593-d6c8-4ceb-9a34-022739706b75: deleted successfully Jul 24 12:42:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:41 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a77333-195f-4aa0-8373-be2024d02853]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:41 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 Jul 24 12:42:41 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:41 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" returned: 0 in 0.445s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:41 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5 Jul 24 12:42:41 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:41 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" returned: 0 in 0.350s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-9a0d0488-2cb6-47ca-bdc4-99e55e3b07d5" released by "delete_volume" :: held 0.941s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" acquired by "delete_volume" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[44197142-5250-416b-8821-8071303df2c8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:42 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:42 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:42 devstack sudo[94665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf Jul 24 12:42:42 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:42 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.347s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 8 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:42:42 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" returned: 0 in 0.554s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:42 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf Jul 24 12:42:42 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:43 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" returned: 0 in 0.566s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Flow 'volume_create_manager' (a3995f2d-69f3-4d98-9ba4-384bbaed7c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe3586f-28b5-4d96-a7a3-53331e50c429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-b60c9241-ee0c-435b-9589-1eb0c77fbdaf" released by "delete_volume" :: held 1.268s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe3586f-28b5-4d96-a7a3-53331e50c429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-105945234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa396eb4-42e7-4b5e-9c4b-719d6abd1955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6ff3fb303465a8b38d4769b43de8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:43Z,use_quota=True,user_id='eb324b51c00245eeb8b8168db5c1f34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10a76b5-5d93-40ce-bcdb-f759b146ac9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e10a76b5-5d93-40ce-bcdb-f759b146ac9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07a7b4f-46e1-4f58-87e1-a67dae9d6b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07a7b4f-46e1-4f58-87e1-a67dae9d6b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa396eb4-42e7-4b5e-9c4b-719d6abd1955', 'volume_name': 'volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebc6013-60a8-49f8-8a33-6940c7ffe708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebc6013-60a8-49f8-8a33-6940c7ffe708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ab729a-c3e6-4dfb-bdc3-5eab42d43ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:43 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Volume aa396eb4-42e7-4b5e-9c4b-719d6abd1955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955', 'volume_size': 1} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-105945234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa396eb4-42e7-4b5e-9c4b-719d6abd1955,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6ff3fb303465a8b38d4769b43de8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:43Z,use_quota=True,user_id='eb324b51c00245eeb8b8168db5c1f34e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Creating volume aa396eb4-42e7-4b5e-9c4b-719d6abd1955 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:42:43 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:43 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 1073741824 Jul 24 12:42:43 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['a21303e8-f875-4eb7-93ad-80df4dcb4eb5'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:43 devstack cinder-volume[88540]: WARNING cinder.quota [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1766351852 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1766351852, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['c058bf71-0ac1-4aea-adaa-17d5461b2d67', 'a452b768-47df-4cce-a583-880d0b4ce81b', 'c628764a-ba9a-4419-83fd-71911b219988', 'f58e71b3-d711-4c98-bde1-18a9319f5c5d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['11cd1484-54d1-43a1-a269-6657bf01a028', '09a2ce49-c8e0-43fb-87b0-270770bdfa77', 'f44f879e-92b8-4d4f-a3e8-b414f0ff7ac2', '187df086-5591-4355-9cb3-00b146265cfe'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:43 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:43 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:44 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.447s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-16f20898-9676-4942-9b5d-27f9f7137bfe tempest-GroupSnapshotsTest-1736545540 None] Delete group completed successfully. Jul 24 12:42:44 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 1073741824" returned: 0 in 0.976s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=128,cinder:UPDATE=137,cinder:INSERT=28,cinder:DELETE=4 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=114,cinder:SELECT=128,cinder:INSERT=28,cinder:DELETE=6 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:44 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 Jul 24 12:42:44 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6b8579c1-3f24-4812-92ea-a979c0276094 tempest-GroupSnapshotsTest-1736545540 None] Group tempest-GroupSnapshotsTest-Group-347352886: creating Jul 24 12:42:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6b8579c1-3f24-4812-92ea-a979c0276094 tempest-GroupSnapshotsTest-1736545540 None] Group tempest-GroupSnapshotsTest-Group-347352886: created successfully Jul 24 12:42:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6b8579c1-3f24-4812-92ea-a979c0276094 tempest-GroupSnapshotsTest-1736545540 None] Create group completed successfully. Jul 24 12:42:44 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955" returned: 0 in 0.476s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9ab729a-c3e6-4dfb-bdc3-5eab42d43ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9665dd4b-a782-4e53-892d-aad8c22748a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:44 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Volume volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 (aa396eb4-42e7-4b5e-9c4b-719d6abd1955): created successfully Jul 24 12:42:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9665dd4b-a782-4e53-892d-aad8c22748a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Flow 'volume_create_manager' (a3995f2d-69f3-4d98-9ba4-384bbaed7c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:45 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fa6d8ac0-9d31-458c-8856-fd8603dc2a6c tempest-ServersNegativeTestJSON-2077195044 None] Created volume successfully. Jul 24 12:42:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "cinder-aa396eb4-42e7-4b5e-9c4b-719d6abd1955-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Lock "cinder-aa396eb4-42e7-4b5e-9c4b-719d6abd1955-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "cinder-quobyte-aa396eb4-42e7-4b5e-9c4b-719d6abd1955" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Lock "cinder-quobyte-aa396eb4-42e7-4b5e-9c4b-719d6abd1955" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:46 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df0c3a8-5987-44db-89ce-ca822da2e6e1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:46 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 Jul 24 12:42:46 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Flow 'volume_create_manager' (a4f278d5-6713-42cb-a514-1249263e66ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9a8615-cf34-46e7-ac0e-6e9303350982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f9a8615-cf34-46e7-ac0e-6e9303350982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1531357491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c9a2136-6ca3-4154-b940-99b6d37cf7d6,host='devstack@QuobyteHD#QuobyteHD',id=52aa61c0-1250-4fb2-ae6b-d711324bbb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e08d5e298f44e43824b644166919c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:47Z,use_quota=True,user_id='2f48074acf5545879333d13710ed3bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0556f60-4d18-4634-b9db-f5e7b72e306e),volume_type_id=f0556f60-4d18-4634-b9db-f5e7b72e306e)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93158e5f-c767-4e9d-9d87-c17dbdc5476c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93158e5f-c767-4e9d-9d87-c17dbdc5476c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d82cc4-45e7-4508-a09d-fdb06269d99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d82cc4-45e7-4508-a09d-fdb06269d99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52aa61c0-1250-4fb2-ae6b-d711324bbb98', 'volume_name': 'volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd87dfcc-3396-4f41-91b6-ea3867198264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd87dfcc-3396-4f41-91b6-ea3867198264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b84c36-0387-4aca-9565-f89c80677b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:47 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Volume 52aa61c0-1250-4fb2-ae6b-d711324bbb98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98', 'volume_size': 1} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c9a2136-6ca3-4154-b940-99b6d37cf7d6,created_at=2026-07-24T10:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1531357491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c9a2136-6ca3-4154-b940-99b6d37cf7d6,host='devstack@QuobyteHD#QuobyteHD',id=52aa61c0-1250-4fb2-ae6b-d711324bbb98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e08d5e298f44e43824b644166919c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:42:47Z,use_quota=True,user_id='2f48074acf5545879333d13710ed3bc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f0556f60-4d18-4634-b9db-f5e7b72e306e),volume_type_id=f0556f60-4d18-4634-b9db-f5e7b72e306e)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Creating volume 52aa61c0-1250-4fb2-ae6b-d711324bbb98 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:42:47 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:47 devstack sudo[94749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 1073741824 Jul 24 12:42:47 devstack sudo[94749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:47 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955" returned: 0 in 0.649s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:47 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955 Jul 24 12:42:47 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:47 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa396eb4-42e7-4b5e-9c4b-719d6abd1955" returned: 0 in 0.366s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Lock "cinder-quobyte-aa396eb4-42e7-4b5e-9c4b-719d6abd1955" released by "delete_volume" :: held 1.112s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Created reservations ['c7ab0d5d-76a1-4434-8930-038a19be84cf', '3b46a2d8-c781-4d35-9a46-dd125e51a514', 'c061cbf1-4176-44fc-8774-19ea6387ea6e', '3dcd00b8-d0cd-478d-954c-a4fefc624bfd'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:47 devstack sudo[94749]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 1073741824" returned: 0 in 0.701s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:48 devstack sudo[94769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 Jul 24 12:42:48 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:48 devstack sudo[94776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:48 devstack sudo[94776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:48 devstack sudo[94776]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.508s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:48 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Deleted volume successfully. Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98" returned: 0 in 0.603s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b84c36-0387-4aca-9565-f89c80677b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3414678c-88a9-4435-8953-63357389255e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af65ad79-9f56-4479-849e-9a2e9f0d4aa5 tempest-ServersNegativeTestJSON-2077195044 None] Lock "cinder-aa396eb4-42e7-4b5e-9c4b-719d6abd1955-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:48 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Volume volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 (52aa61c0-1250-4fb2-ae6b-d711324bbb98): created successfully Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3414678c-88a9-4435-8953-63357389255e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Flow 'volume_create_manager' (a4f278d5-6713-42cb-a514-1249263e66ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:42:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7306c836-c4d3-4290-8986-2d134eb48369 tempest-GroupSnapshotsTest-1736545540 None] Created volume successfully. Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "cinder-04bdf35d-e707-4709-ab3e-1d31a2ce3b75-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Lock "cinder-04bdf35d-e707-4709-ab3e-1d31a2ce3b75-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "cinder-quobyte-04bdf35d-e707-4709-ab3e-1d31a2ce3b75" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Lock "cinder-quobyte-04bdf35d-e707-4709-ab3e-1d31a2ce3b75" acquired by "delete_volume" :: waited 0.027s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:49 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[53310f87-7f40-4ad7-b642-eaba6ffbb72f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:49 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 Jul 24 12:42:49 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:49 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75" returned: 0 in 0.494s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:49 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75 Jul 24 12:42:49 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:49 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04bdf35d-e707-4709-ab3e-1d31a2ce3b75" returned: 0 in 0.335s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Lock "cinder-quobyte-04bdf35d-e707-4709-ab3e-1d31a2ce3b75" released by "delete_volume" :: held 0.893s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:49 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Created reservations ['83982d85-6b41-4cd3-83af-cbcfeae723a6', '7bc670dc-f8a4-400b-8c0e-9ef99ce53e3a', 'f0d9e11a-30dc-4821-adaa-69306c5e7fed', '6ba86996-8a44-484c-84b1-eeecf3e2586f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:50 devstack sudo[94801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:50 devstack sudo[94801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:50 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] GroupSnapshot 910e8c03-6d93-4f31-881c-7bb035630466: creating. Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Group snapshot 910e8c03-6d93-4f31-881c-7bb035630466: creating. {{(pid=88540) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Creating offline snapshot 8e3e433f-5e21-40a5-a56a-9f8212102ce5 of volume 52aa61c0-1250-4fb2-ae6b-d711324bbb98 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb755d7-79b5-4df9-bae4-9101e09b7e0c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:50 devstack sudo[94801]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.417s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:50 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Deleted volume successfully. Jul 24 12:42:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5ba8bb64-d53e-42c1-9d67-1d187c1ae76b tempest-ServersNegativeTestJSON-2077195044 None] Lock "cinder-04bdf35d-e707-4709-ab3e-1d31a2ce3b75-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:50 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 Jul 24 12:42:50 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:51 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98" returned: 0 in 0.772s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:51 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 1G Jul 24 12:42:51 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:51 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 1G" returned: 0 in 0.658s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:51 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 Jul 24 12:42:51 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:52 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5" returned: 0 in 0.387s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:52 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:42:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:52 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 Jul 24 12:42:52 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:52 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5" returned: 0 in 0.322s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:52 devstack sudo[94852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.info Jul 24 12:42:52 devstack sudo[94852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:52 devstack sudo[94852]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.info" returned: 0 in 0.308s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:52 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:42:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:52 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.info Jul 24 12:42:52 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:53 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.info" returned: 0 in 0.276s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-726110ce-5ac1-45d8-bfc2-c71379e1ae58 tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 910e8c03-6d93-4f31-881c-7bb035630466: created successfully Jul 24 12:42:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 910e8c03-6d93-4f31-881c-7bb035630466: deleting Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 910e8c03-6d93-4f31-881c-7bb035630466: deleting {{(pid=88540) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-52aa61c0-1250-4fb2-ae6b-d711324bbb98" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-52aa61c0-1250-4fb2-ae6b-d711324bbb98" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-8e3e433f-5e21-40a5-a56a-9f8212102ce5" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-8e3e433f-5e21-40a5-a56a-9f8212102ce5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Deleting offline snapshot 8e3e433f-5e21-40a5-a56a-9f8212102ce5 of volume 52aa61c0-1250-4fb2-ae6b-d711324bbb98 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] snapshot_file for this snap is: volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf8c2b7-56e0-492c-8c97-4861a5c0f383]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:54 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 Jul 24 12:42:54 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:54 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5" returned: 0 in 0.567s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:42:54 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f55700b-eb34-4e1b-8f19-9f9cc20839e7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:54 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 Jul 24 12:42:54 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:55 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98" returned: 0 in 0.495s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:55 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 Jul 24 12:42:55 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:55 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5" returned: 0 in 0.509s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:55 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5 Jul 24 12:42:55 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:56 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98.8e3e433f-5e21-40a5-a56a-9f8212102ce5" returned: 0 in 0.460s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-8e3e433f-5e21-40a5-a56a-9f8212102ce5" released by "_delete_snapshot" :: held 2.188s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-52aa61c0-1250-4fb2-ae6b-d711324bbb98" released by "delete_snapshot" :: held 2.225s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:56 devstack cinder-volume[88540]: WARNING cinder.quota [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1293774127 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1293774127, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:42:56 devstack cinder-volume[88540]: WARNING cinder.quota [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1293774127 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1293774127, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:42:56 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['05a9786b-8b25-4fd6-9130-c932e3766462', '0b025891-bee4-49e6-88a6-d9b4a29ecf26', '1e2dcc69-e043-4b6e-bce8-457e08f67eac', 'e853d428-bd8c-422e-8e4e-37da4b851747'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-edd6cf08-4d5a-4de4-b6da-bd1201b80296 tempest-GroupSnapshotsTest-1736545540 None] group_snapshot 910e8c03-6d93-4f31-881c-7bb035630466: deleted successfully Jul 24 12:42:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "cinder-quobyte-52aa61c0-1250-4fb2-ae6b-d711324bbb98" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:42:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-52aa61c0-1250-4fb2-ae6b-d711324bbb98" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:42:57 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce15284-fed9-40db-94b3-1ab5ab4ab871]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:42:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:58 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 Jul 24 12:42:58 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:58 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98" returned: 0 in 0.566s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:58 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98 Jul 24 12:42:58 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:58 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-52aa61c0-1250-4fb2-ae6b-d711324bbb98" returned: 0 in 0.308s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Lock "cinder-quobyte-52aa61c0-1250-4fb2-ae6b-d711324bbb98" released by "delete_volume" :: held 1.014s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:42:58 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['d68c66d0-6c9d-43f0-a76f-1b1bd5d8d9bc'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:59 devstack cinder-volume[88540]: WARNING cinder.quota [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1293774127 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1293774127, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:42:59 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Created reservations ['7ef9bdc6-9f2a-4a8c-aed3-d73441918bfe', 'adaffa68-db0d-4cc2-9da1-03ec843632f5', 'f4c74246-05ca-49cb-a35f-86660e5c3bf8', '2dc36397-b057-42af-8df4-fb3d4e8625fc'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:42:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:42:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:42:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:42:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:42:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:42:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:42:59 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:42:59 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:42:59 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jul 24 12:42:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.349s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:42:59 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:42:59 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b386c33f-eeab-4aac-ba72-dc9b3c9d5462 tempest-GroupSnapshotsTest-1736545540 None] Delete group completed successfully. Jul 24 12:43:09 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=32,cinder:INSERT=13,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:43:09 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=38,cinder:UPDATE=44,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:43:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-da4a6099-81d9-4d2a-a987-c34ca79ccf5d tempest-GroupSnapshotsV319Test-2049066699 None] Group tempest-GroupSnapshotsV319Test-Group-1066064117: creating Jul 24 12:43:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-da4a6099-81d9-4d2a-a987-c34ca79ccf5d tempest-GroupSnapshotsV319Test-2049066699 None] Group tempest-GroupSnapshotsV319Test-Group-1066064117: created successfully Jul 24 12:43:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-da4a6099-81d9-4d2a-a987-c34ca79ccf5d tempest-GroupSnapshotsV319Test-2049066699 None] Create group completed successfully. Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Flow 'volume_create_manager' (a97190b9-6d77-4b7d-b1a7-963547c591e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb199e92-f7a5-41c1-8079-fd55163ccd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb199e92-f7a5-41c1-8079-fd55163ccd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806859197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15a7c6dc-21c1-46f6-9c11-8e4ff322a1a2,host='devstack@QuobyteHD#QuobyteHD',id=a496279a-450a-43bd-8e84-96b235557c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fffd15a9984fb98964283ba07da57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:15Z,use_quota=True,user_id='292a7f0c093045179a53c39bc9ed4d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc47895a-156e-410d-9bf2-004bd180e53c),volume_type_id=dc47895a-156e-410d-9bf2-004bd180e53c)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80029f87-90aa-4847-90f4-d75dc75862b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80029f87-90aa-4847-90f4-d75dc75862b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a5442e-38ba-4ad3-8566-d06d433d5e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a5442e-38ba-4ad3-8566-d06d433d5e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a496279a-450a-43bd-8e84-96b235557c22', 'volume_name': 'volume-a496279a-450a-43bd-8e84-96b235557c22', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6064a0a0-4cb2-4f61-a659-2a77ad608390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6064a0a0-4cb2-4f61-a659-2a77ad608390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f7a9a-1927-4645-83ef-9c6ca8155816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:15 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Volume a496279a-450a-43bd-8e84-96b235557c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a496279a-450a-43bd-8e84-96b235557c22', 'volume_size': 1} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15a7c6dc-21c1-46f6-9c11-8e4ff322a1a2,created_at=2026-07-24T10:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806859197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15a7c6dc-21c1-46f6-9c11-8e4ff322a1a2,host='devstack@QuobyteHD#QuobyteHD',id=a496279a-450a-43bd-8e84-96b235557c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fffd15a9984fb98964283ba07da57b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:15Z,use_quota=True,user_id='292a7f0c093045179a53c39bc9ed4d78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc47895a-156e-410d-9bf2-004bd180e53c),volume_type_id=dc47895a-156e-410d-9bf2-004bd180e53c)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Creating volume a496279a-450a-43bd-8e84-96b235557c22 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:43:15 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:43:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:15 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 1073741824 Jul 24 12:43:15 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-441e1963-5ed8-42f8-a81f-0e01c28eb95d tempest-GroupsV314Test-1270878288 None] Group tempest-GroupsV314Test-Group-817290694: creating Jul 24 12:43:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-441e1963-5ed8-42f8-a81f-0e01c28eb95d tempest-GroupsV314Test-1270878288 None] Group tempest-GroupsV314Test-Group-817290694: created successfully Jul 24 12:43:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-441e1963-5ed8-42f8-a81f-0e01c28eb95d tempest-GroupsV314Test-1270878288 None] Create group completed successfully. Jul 24 12:43:16 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 1073741824" returned: 0 in 1.100s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:16 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 Jul 24 12:43:16 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:16 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22" returned: 0 in 0.474s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:43:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7f7a9a-1927-4645-83ef-9c6ca8155816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a496279a-450a-43bd-8e84-96b235557c22', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b441e5b1-23d0-4f66-9218-0a5104dd0866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:17 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Volume volume-a496279a-450a-43bd-8e84-96b235557c22 (a496279a-450a-43bd-8e84-96b235557c22): created successfully Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b441e5b1-23d0-4f66-9218-0a5104dd0866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Flow 'volume_create_manager' (a97190b9-6d77-4b7d-b1a7-963547c591e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:17 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0f04ad03-8f1a-419d-ae3a-5a26c76ec593 tempest-GroupSnapshotsV319Test-2049066699 None] Created volume successfully. Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Flow 'volume_create_manager' (a17f553c-87dc-4984-9c21-7d9d45879f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5586d4e6-6f48-4787-976c-da5523d32a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5586d4e6-6f48-4787-976c-da5523d32a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-906131633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153d9e28-3041-470a-8205-0e32f3fa2fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962b0fbe5d64415a904bd5531a471005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:18Z,use_quota=True,user_id='2cc2522029194768b8ec2795e74fa783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158f3911-c960-4696-bb6d-53a1a2b29b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158f3911-c960-4696-bb6d-53a1a2b29b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfed1cd-3caf-4c73-adce-ee6692290c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfed1cd-3caf-4c73-adce-ee6692290c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '153d9e28-3041-470a-8205-0e32f3fa2fdd', 'volume_name': 'volume-153d9e28-3041-470a-8205-0e32f3fa2fdd', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cef24e8-2973-4e9f-8c9d-a3b7eae42f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cef24e8-2973-4e9f-8c9d-a3b7eae42f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f693dbca-7183-4bb1-a147-efcc72ba9f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:17 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Volume 153d9e28-3041-470a-8205-0e32f3fa2fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-153d9e28-3041-470a-8205-0e32f3fa2fdd', 'volume_size': 1} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-906131633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=153d9e28-3041-470a-8205-0e32f3fa2fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962b0fbe5d64415a904bd5531a471005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:18Z,use_quota=True,user_id='2cc2522029194768b8ec2795e74fa783',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Creating volume 153d9e28-3041-470a-8205-0e32f3fa2fdd {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:43:17 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:43:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:17 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd 1073741824 Jul 24 12:43:17 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Flow 'volume_create_manager' (5ba00bbf-cd37-44ea-8333-a5e7b57fb7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f11fb9a-eb10-4b3e-acaf-a094307dc8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f11fb9a-eb10-4b3e-acaf-a094307dc8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1990611494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6b7a737-49f7-4be4-9127-29ef10c24e0b,host='devstack@QuobyteHD#QuobyteHD',id=6ab1615b-d9e6-40be-87ce-3a054cdd0c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb58ee21f0be42a6978e32422633a173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:18Z,use_quota=True,user_id='c07a9e4d19a64bccb112c95dbe3c6c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe5e755-df28-46f6-8afc-d50819c7fb8b),volume_type_id=9fe5e755-df28-46f6-8afc-d50819c7fb8b)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095da955-cb93-44bc-aadc-76456cfc9763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (095da955-cb93-44bc-aadc-76456cfc9763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2032c604-3df5-409c-80da-a9151f4d5968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2032c604-3df5-409c-80da-a9151f4d5968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ab1615b-d9e6-40be-87ce-3a054cdd0c30', 'volume_name': 'volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92718c2b-8cf8-4dbc-b2a4-95020bd9c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92718c2b-8cf8-4dbc-b2a4-95020bd9c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043dc6f9-a6f9-4d0f-a6b5-38e43dc989d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:18 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Volume 6ab1615b-d9e6-40be-87ce-3a054cdd0c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30', 'volume_size': 1} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] GroupSnapshot dd302f42-2ae5-49b5-941c-994fe9c7734c: creating. Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Group snapshot dd302f42-2ae5-49b5-941c-994fe9c7734c: creating. {{(pid=88540) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:18 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd 1073741824" returned: 0 in 1.045s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:18 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd Jul 24 12:43:18 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:19 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd" returned: 0 in 0.286s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.493s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b6b7a737-49f7-4be4-9127-29ef10c24e0b,created_at=2026-07-24T10:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1990611494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b6b7a737-49f7-4be4-9127-29ef10c24e0b,host='devstack@QuobyteHD#QuobyteHD',id=6ab1615b-d9e6-40be-87ce-3a054cdd0c30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb58ee21f0be42a6978e32422633a173',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:18Z,use_quota=True,user_id='c07a9e4d19a64bccb112c95dbe3c6c9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fe5e755-df28-46f6-8afc-d50819c7fb8b),volume_type_id=9fe5e755-df28-46f6-8afc-d50819c7fb8b)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Creating volume 6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:43:19 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f693dbca-7183-4bb1-a147-efcc72ba9f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-153d9e28-3041-470a-8205-0e32f3fa2fdd', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:19 devstack sudo[95246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 1073741824 Jul 24 12:43:19 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db81e8b-0167-4138-9902-917e5c1d6c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Volume volume-153d9e28-3041-470a-8205-0e32f3fa2fdd (153d9e28-3041-470a-8205-0e32f3fa2fdd): created successfully Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4db81e8b-0167-4138-9902-917e5c1d6c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Flow 'volume_create_manager' (a17f553c-87dc-4984-9c21-7d9d45879f33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-39a44bdb-d21b-42b6-9e11-cbbf05ef1813 tempest-ServerRescueNegativeTestJSON-976008908 None] Created volume successfully. Jul 24 12:43:19 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 1073741824" returned: 0 in 0.455s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:19 devstack sudo[95252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 Jul 24 12:43:19 devstack sudo[95252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:19 devstack sudo[95252]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" returned: 0 in 0.264s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:43:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.155s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Creating offline snapshot 205a6844-9220-47b2-8f22-b89c13b39365 of volume a496279a-450a-43bd-8e84-96b235557c22 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (043dc6f9-a6f9-4d0f-a6b5-38e43dc989d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e62023-c561-4fa6-bdc3-31c388ff25a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0ce875-228b-482f-9c42-289db1f45351]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:20 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Volume volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 (6ab1615b-d9e6-40be-87ce-3a054cdd0c30): created successfully Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e62023-c561-4fa6-bdc3-31c388ff25a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Flow 'volume_create_manager' (5ba00bbf-cd37-44ea-8333-a5e7b57fb7f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:20 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0d541166-5a9d-4234-9881-84d0476babb1 tempest-GroupsV314Test-1270878288 None] Created volume successfully. Jul 24 12:43:20 devstack sudo[95255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 Jul 24 12:43:20 devstack sudo[95255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:20 devstack sudo[95255]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22" returned: 0 in 0.565s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:20 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 1G Jul 24 12:43:20 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:21 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 1G" returned: 0 in 0.766s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a496279a-450a-43bd-8e84-96b235557c22 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:21 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a496279a-450a-43bd-8e84-96b235557c22 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 Jul 24 12:43:21 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:21 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a496279a-450a-43bd-8e84-96b235557c22 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365" returned: 0 in 0.732s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:22 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:43:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:22 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 Jul 24 12:43:22 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:22 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365" returned: 0 in 0.372s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:22 devstack sudo[95291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.info Jul 24 12:43:22 devstack sudo[95291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:22 devstack sudo[95291]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.info" returned: 0 in 0.351s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:22 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:43:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:22 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.info Jul 24 12:43:22 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:23 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.info" returned: 0 in 0.419s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.325s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.106s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:23 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Cloning volume 6ab1615b-d9e6-40be-87ce-3a054cdd0c30 to volume 7f6eb103-8086-4d63-bcd5-ad2a5e549239 Jul 24 12:43:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Creating offline snapshot 0d22f581-3010-4527-bb91-a3d2ac594419 of volume 6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:43:23 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73a8f6c-0b75-450c-953b-c5ba35494628]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-08560100-faf0-47b2-a530-73a781b72ec3 tempest-GroupSnapshotsV319Test-2049066699 None] group_snapshot dd302f42-2ae5-49b5-941c-994fe9c7734c: created successfully Jul 24 12:43:23 devstack sudo[95311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 Jul 24 12:43:23 devstack sudo[95311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:24 devstack sudo[95311]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" returned: 0 in 0.581s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:24 devstack sudo[95330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 1G Jul 24 12:43:24 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:24 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 1G" returned: 0 in 0.758s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:24 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 Jul 24 12:43:24 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] group_snapshot dd302f42-2ae5-49b5-941c-994fe9c7734c: deleting Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] group_snapshot dd302f42-2ae5-49b5-941c-994fe9c7734c: deleting {{(pid=88540) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Acquiring lock "cinder-quobyte-a496279a-450a-43bd-8e84-96b235557c22" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "cinder-quobyte-a496279a-450a-43bd-8e84-96b235557c22" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Acquiring lock "cinder-quobyte-205a6844-9220-47b2-8f22-b89c13b39365" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "cinder-quobyte-205a6844-9220-47b2-8f22-b89c13b39365" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Deleting offline snapshot 205a6844-9220-47b2-8f22-b89c13b39365 of volume a496279a-450a-43bd-8e84-96b235557c22 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] snapshot_file for this snap is: volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb7029-573c-45b7-aaba-980b1c14870a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:25 devstack sudo[95348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 Jul 24 12:43:25 devstack sudo[95348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:25 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419" returned: 0 in 0.749s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:25 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:25 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 Jul 24 12:43:25 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:25 devstack sudo[95348]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365" returned: 0 in 0.537s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a496279a-450a-43bd-8e84-96b235557c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[500d6d8f-7b04-43e6-8afb-fc0c433bb53a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:25 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419" returned: 0 in 0.356s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:26 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.info Jul 24 12:43:26 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:26 devstack sudo[95358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 Jul 24 12:43:26 devstack sudo[95358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:26 devstack sudo[95358]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22" returned: 0 in 0.767s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:26 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 Jul 24 12:43:26 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:26 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.info" returned: 0 in 0.692s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:26 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:43:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:26 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.info Jul 24 12:43:26 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:27 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365" returned: 0 in 0.654s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:27 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.info" returned: 0 in 0.607s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:27 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365 Jul 24 12:43:27 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Acquiring lock "cinder-quobyte-7f6eb103-8086-4d63-bcd5-ad2a5e549239" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Lock "cinder-quobyte-7f6eb103-8086-4d63-bcd5-ad2a5e549239" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] snapshot: 0d22f581-3010-4527-bb91-a3d2ac594419, volume: 7f6eb103-8086-4d63-bcd5-ad2a5e549239, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a0e231-3d37-4704-a9ac-10616949fd62]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:27 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 Jul 24 12:43:27 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:27 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22.205a6844-9220-47b2-8f22-b89c13b39365" returned: 0 in 0.683s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "cinder-quobyte-205a6844-9220-47b2-8f22-b89c13b39365" released by "_delete_snapshot" :: held 2.864s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "cinder-quobyte-a496279a-450a-43bd-8e84-96b235557c22" released by "delete_snapshot" :: held 2.904s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:28 devstack cinder-volume[88540]: WARNING cinder.quota [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1275293977 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1275293977, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:43:28 devstack cinder-volume[88540]: WARNING cinder.quota [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1275293977 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1275293977, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] Created reservations ['aee0cbb8-2e64-4faa-9dc6-edca09c56725', 'e522fd22-3ee2-4bc9-b29a-ff8efc09a910', '7c5432d9-1e56-4d2b-a420-0adb1d0c54f1', '35a6c82a-a958-40f1-a217-1e6f94c01fc4'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:43:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-72d0a619-df28-4d5b-abf1-d64e355f2cf3 tempest-GroupSnapshotsV319Test-2049066699 None] group_snapshot dd302f42-2ae5-49b5-941c-994fe9c7734c: deleted successfully Jul 24 12:43:28 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419" returned: 0 in 0.983s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4186e14-75d2-415b-925f-5437e6efed61]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:28 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 Jul 24 12:43:28 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:28 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" returned: 0 in 0.539s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:29 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:43:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:29 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 Jul 24 12:43:29 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Acquiring lock "cinder-quobyte-a496279a-450a-43bd-8e84-96b235557c22" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "cinder-quobyte-a496279a-450a-43bd-8e84-96b235557c22" acquired by "delete_volume" :: waited 0.066s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[70baed87-dd65-4173-aeb6-8f2761e8d50c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:29 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 Jul 24 12:43:29 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:30 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22" returned: 0 in 0.977s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:30 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22 Jul 24 12:43:30 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:31 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a496279a-450a-43bd-8e84-96b235557c22" returned: 0 in 0.762s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "cinder-quobyte-a496279a-450a-43bd-8e84-96b235557c22" released by "delete_volume" :: held 1.959s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:31 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Created reservations ['932ef88a-ac37-4871-933e-560f80affee3'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:43:31 devstack cinder-volume[88540]: WARNING cinder.quota [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1275293977 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1275293977, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:43:31 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Created reservations ['7158c695-3e53-422a-95a5-bde480837cc7', 'e30e44aa-131e-46aa-89b1-4ce6ee18fee7', 'bb245781-caf2-4d2d-94f6-3a11569ddce3', 'b01f6d79-1df1-4c93-a8b6-62a9be2fe5f2'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:43:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:32 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:43:32 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:32 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.776s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:33 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:43:33 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-68251a58-9c86-4a20-a43f-0df87ed11456 tempest-GroupSnapshotsV319Test-2049066699 None] Delete group completed successfully. Jul 24 12:43:36 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239" returned: 0 in 7.304s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:36 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[509b7669-5211-4223-85d7-f9cb5e7c390b]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:36 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 Jul 24 12:43:36 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Acquiring lock "cinder-153d9e28-3041-470a-8205-0e32f3fa2fdd-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "cinder-153d9e28-3041-470a-8205-0e32f3fa2fdd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Acquiring lock "cinder-quobyte-153d9e28-3041-470a-8205-0e32f3fa2fdd" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "cinder-quobyte-153d9e28-3041-470a-8205-0e32f3fa2fdd" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:36 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d295e77-8d81-4328-80b4-0217983ba06f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:37 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd Jul 24 12:43:37 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:37 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" returned: 0 in 0.805s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30, size 1024.00 MB, duration 7.30 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:43:37 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Converted 1024.00 MB image at 140.19 MB/s Jul 24 12:43:37 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:37 devstack sudo[95511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 Jul 24 12:43:37 devstack sudo[95511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:37 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd" returned: 0 in 0.596s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:37 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd Jul 24 12:43:37 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:37 devstack sudo[95511]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239" returned: 0 in 0.457s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Lock "cinder-quobyte-7f6eb103-8086-4d63-bcd5-ad2a5e549239" released by "_copy_volume_from_snapshot" :: held 10.262s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Acquiring lock "cinder-quobyte-0d22f581-3010-4527-bb91-a3d2ac594419" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Lock "cinder-quobyte-0d22f581-3010-4527-bb91-a3d2ac594419" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Deleting offline snapshot 0d22f581-3010-4527-bb91-a3d2ac594419 of volume 6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] snapshot_file for this snap is: volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[033477f4-e61b-4682-a5bf-9bcf46d05f82]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:37 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-153d9e28-3041-470a-8205-0e32f3fa2fdd" returned: 0 in 0.563s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "cinder-quobyte-153d9e28-3041-470a-8205-0e32f3fa2fdd" released by "delete_volume" :: held 1.251s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:38 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 Jul 24 12:43:38 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Created reservations ['306243cd-463f-4aa9-815c-581bfcb5c7cf', '86f2fbd6-88c9-43bf-871a-965c6e9dcfc4', '88e4ab61-7c92-4433-9e32-ae7a9ad8b31c', 'e20bc73b-bdd3-45c3-bf46-a0eddb8bab4d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:38 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:43:38 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:38 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419" returned: 0 in 0.789s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e5dbd0-f9a7-4702-969b-abb751f6ecaf]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:38 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.444s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:43:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Deleted volume successfully. Jul 24 12:43:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e74964cb-edb0-407e-a890-58755440d8ad tempest-ServerRescueNegativeTestJSON-976008908 None] Lock "cinder-153d9e28-3041-470a-8205-0e32f3fa2fdd-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:38 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 Jul 24 12:43:38 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:39 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" returned: 0 in 0.851s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:39 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 Jul 24 12:43:39 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:40 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419" returned: 0 in 0.656s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:40 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419 Jul 24 12:43:40 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:40 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30.0d22f581-3010-4527-bb91-a3d2ac594419" returned: 0 in 0.703s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Lock "cinder-quobyte-0d22f581-3010-4527-bb91-a3d2ac594419" released by "_delete_snapshot" :: held 3.255s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.693s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0392b88d-165f-4f37-8371-0a09a5b09e67 tempest-GroupsV314Test-1270878288 None] Create group from source-group-b6b7a737-49f7-4be4-9127-29ef10c24e0b completed successfully. Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Flow 'volume_create_manager' (6339dcbc-b03c-494c-a506-b7f2db6a381a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f028bc55-537b-412d-af8d-76f8e83e24cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f028bc55-537b-412d-af8d-76f8e83e24cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2098688109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e08b76-2c4d-4694-860f-95d29ab7f05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6ff75c9754b7db5d6e37701bd8f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:41Z,use_quota=True,user_id='a58f0df130f34f39b71a7f0b34b8658e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db082e48-f29a-40df-ac36-252ed75c8b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db082e48-f29a-40df-ac36-252ed75c8b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabd77a7-cd0f-474b-8c1d-a57f9bc4e367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aabd77a7-cd0f-474b-8c1d-a57f9bc4e367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e08b76-2c4d-4694-860f-95d29ab7f05f', 'volume_name': 'volume-99e08b76-2c4d-4694-860f-95d29ab7f05f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cec2828-9f01-45bc-9483-d6bfe87e323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cec2828-9f01-45bc-9483-d6bfe87e323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b22bb9f-f7f2-424b-b804-c52e56846c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:41 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Volume 99e08b76-2c4d-4694-860f-95d29ab7f05f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e08b76-2c4d-4694-860f-95d29ab7f05f', 'volume_size': 1} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2098688109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e08b76-2c4d-4694-860f-95d29ab7f05f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6ff75c9754b7db5d6e37701bd8f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:41Z,use_quota=True,user_id='a58f0df130f34f39b71a7f0b34b8658e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Creating volume 99e08b76-2c4d-4694-860f-95d29ab7f05f {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:43:41 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:43:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:41 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f 1073741824 Jul 24 12:43:41 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:42 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:43:42 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:42 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f 1073741824" returned: 0 in 1.061s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Acquiring lock "cinder-quobyte-7f6eb103-8086-4d63-bcd5-ad2a5e549239" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Lock "cinder-quobyte-7f6eb103-8086-4d63-bcd5-ad2a5e549239" acquired by "delete_volume" :: waited 0.057s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:42 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.855s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff3187c-e03b-433a-abae-8864de7affdc]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:43 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f Jul 24 12:43:43 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 8 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:43:43 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 Jul 24 12:43:43 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:43 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f" returned: 0 in 0.509s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b22bb9f-f7f2-424b-b804-c52e56846c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e08b76-2c4d-4694-860f-95d29ab7f05f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837cdb17-874f-4a48-80f5-19a6e41ccbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:43 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Volume volume-99e08b76-2c4d-4694-860f-95d29ab7f05f (99e08b76-2c4d-4694-860f-95d29ab7f05f): created successfully Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (837cdb17-874f-4a48-80f5-19a6e41ccbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Flow 'volume_create_manager' (6339dcbc-b03c-494c-a506-b7f2db6a381a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:43 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-050fc793-249d-4eb7-b264-d6fb599ff007 tempest-AttachVolumeNegativeTest-387448775 None] Created volume successfully. Jul 24 12:43:43 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239" returned: 0 in 0.598s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:43 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239 Jul 24 12:43:43 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:44 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7f6eb103-8086-4d63-bcd5-ad2a5e549239" returned: 0 in 0.537s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Lock "cinder-quobyte-7f6eb103-8086-4d63-bcd5-ad2a5e549239" released by "delete_volume" :: held 1.289s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Created reservations ['0721096d-2270-459d-886d-b1bcd25c8bc8'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:43:44 devstack cinder-volume[88540]: WARNING cinder.quota [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-74789554 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-74789554, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:43:44 devstack cinder-volume[88540]: WARNING cinder.quota [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-74789554 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-74789554, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Created reservations ['e6bfb01b-f231-48c3-9bef-ad4490c8f3c4', 'ae145a03-9db7-4aa7-ac2c-663aba5a6275', 'aa3b1274-df08-4e78-8c6f-c7ac0dc52d3f', '98e06623-8f35-4621-aa73-d8fd2b595ae6'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:44 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:43:44 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:45 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.313s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:45 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:43:45 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8040ded0-a9da-4e13-a459-979dc2370c98 tempest-GroupsV314Test-1270878288 None] Delete group completed successfully. Jul 24 12:43:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-6f0f3a7d-f164-472a-b5d0-5ef4bc4edd85 req-2147bf53-64e1-4b25-878f-82521fb257b9 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-6f0f3a7d-f164-472a-b5d0-5ef4bc4edd85 req-2147bf53-64e1-4b25-878f-82521fb257b9 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-6f0f3a7d-f164-472a-b5d0-5ef4bc4edd85 req-2147bf53-64e1-4b25-878f-82521fb257b9 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-6f0f3a7d-f164-472a-b5d0-5ef4bc4edd85 req-2147bf53-64e1-4b25-878f-82521fb257b9 tempest-AttachVolumeNegativeTest-387448775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-99e08b76-2c4d-4694-860f-95d29ab7f05f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d1b5e4a-7a37-49cf-af1b-e713ba937ec6', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:43:45 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-6f0f3a7d-f164-472a-b5d0-5ef4bc4edd85 req-2147bf53-64e1-4b25-878f-82521fb257b9 tempest-AttachVolumeNegativeTest-387448775 None] attachment_update completed successfully. Jul 24 12:43:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Acquiring lock "cinder-quobyte-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Lock "cinder-quobyte-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" acquired by "delete_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:46 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09b7921-f76f-4fa9-9205-5b496328b00b]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:46 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 Jul 24 12:43:46 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:46 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" returned: 0 in 0.594s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:46 devstack sudo[96066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30 Jul 24 12:43:46 devstack sudo[96066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:47 devstack sudo[96066]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" returned: 0 in 0.376s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Lock "cinder-quobyte-6ab1615b-d9e6-40be-87ce-3a054cdd0c30" released by "delete_volume" :: held 1.077s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Created reservations ['585892fc-e265-4da3-9f93-83bbabbce5a4'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Created reservations ['efa862c8-4682-431b-a124-390f0afca60c', '1da83968-23db-4e06-840f-88f86b6c064a', '09b4f03f-ef9b-4e16-aff3-7b46ec5aa316', '8587da41-4bde-4488-afd9-831ddce0f61e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:47 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:43:47 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:47 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.319s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:47 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:43:47 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-13ed67f9-1643-4048-8f90-192a47848645 tempest-GroupsV314Test-1270878288 None] Delete group completed successfully. Jul 24 12:43:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5cbb49d7-e067-48ac-8c05-67edd143b281 tempest-GroupsTest-599987216 None] Group tempest-Group1-1510024309: creating Jul 24 12:43:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5cbb49d7-e067-48ac-8c05-67edd143b281 tempest-GroupsTest-599987216 None] Group tempest-Group1-1510024309: created successfully Jul 24 12:43:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5cbb49d7-e067-48ac-8c05-67edd143b281 tempest-GroupsTest-599987216 None] Create group completed successfully. Jul 24 12:43:52 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f5667eda-977a-45aa-9d63-8f8c6eec3788 tempest-GroupsTest-599987216 None] Group tempest-Group2-822883195: creating Jul 24 12:43:52 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f5667eda-977a-45aa-9d63-8f8c6eec3788 tempest-GroupsTest-599987216 None] Group tempest-Group2-822883195: created successfully Jul 24 12:43:52 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f5667eda-977a-45aa-9d63-8f8c6eec3788 tempest-GroupsTest-599987216 None] Create group completed successfully. Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Flow 'volume_create_manager' (0a7d74e1-2069-471a-90ff-131ed6f3b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877285cf-8172-42c1-be25-7d406fb5b4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877285cf-8172-42c1-be25-7d406fb5b4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-422895975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b9901d5-82a7-4fb5-b2af-57b5eefdfe5c,host='devstack@QuobyteHD#QuobyteHD',id=06255b5b-bb2a-4339-8ef2-d6129c10f5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7992457fc1d41368569468dbe3008d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:55Z,use_quota=True,user_id='fa3ccc3464c343ceb8a683dfbcb2df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1005002-d508-4855-9809-974e398b44bf),volume_type_id=d1005002-d508-4855-9809-974e398b44bf)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2d1bf2-eee9-48e7-91d9-c96cabdde96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2d1bf2-eee9-48e7-91d9-c96cabdde96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3c1821-81f8-4904-98fa-dec3386b3116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3c1821-81f8-4904-98fa-dec3386b3116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06255b5b-bb2a-4339-8ef2-d6129c10f5f9', 'volume_name': 'volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d697b9b0-7ebf-4752-a890-65c44195f6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d697b9b0-7ebf-4752-a890-65c44195f6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e84380-edf6-431e-bce4-380443bea697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:55 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Volume 06255b5b-bb2a-4339-8ef2-d6129c10f5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9', 'volume_size': 1} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4b9901d5-82a7-4fb5-b2af-57b5eefdfe5c,created_at=2026-07-24T10:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-422895975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4b9901d5-82a7-4fb5-b2af-57b5eefdfe5c,host='devstack@QuobyteHD#QuobyteHD',id=06255b5b-bb2a-4339-8ef2-d6129c10f5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7992457fc1d41368569468dbe3008d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:55Z,use_quota=True,user_id='fa3ccc3464c343ceb8a683dfbcb2df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1005002-d508-4855-9809-974e398b44bf),volume_type_id=d1005002-d508-4855-9809-974e398b44bf)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Creating volume 06255b5b-bb2a-4339-8ef2-d6129c10f5f9 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:43:55 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:55 devstack sudo[96104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 1073741824 Jul 24 12:43:55 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:55 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 1073741824" returned: 0 in 0.526s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:55 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 Jul 24 12:43:55 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:56 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9" returned: 0 in 0.290s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:43:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e84380-edf6-431e-bce4-380443bea697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dd1398-7c8e-487d-ac86-fd65ca954a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:56 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Volume volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 (06255b5b-bb2a-4339-8ef2-d6129c10f5f9): created successfully Jul 24 12:43:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54dd1398-7c8e-487d-ac86-fd65ca954a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Flow 'volume_create_manager' (0a7d74e1-2069-471a-90ff-131ed6f3b73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fac57c85-5b6b-421a-baa1-84b1e6aaf117 tempest-GroupsTest-599987216 None] Created volume successfully. Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Acquiring lock "cinder-quobyte-06255b5b-bb2a-4339-8ef2-d6129c10f5f9" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Lock "cinder-quobyte-06255b5b-bb2a-4339-8ef2-d6129c10f5f9" acquired by "delete_volume" :: waited 0.059s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f424f-d096-4b67-95ff-866fdd90a784]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Flow 'volume_create_manager' (c41c0e16-ba89-4a00-a892-1f569a150462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914e1b69-0c2b-436a-9baf-e452778bf1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (914e1b69-0c2b-436a-9baf-e452778bf1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1189528806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc85b5ef-e87f-40ee-b139-2d32288b8a8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cc533d550c94af7895acb064d416289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:59Z,use_quota=True,user_id='8b98894058774301809160371583146d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0a2a95-84b7-422d-b231-b609a369d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0a2a95-84b7-422d-b231-b609a369d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe1638f-febb-4494-8a70-04681c11ca74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbe1638f-febb-4494-8a70-04681c11ca74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc85b5ef-e87f-40ee-b139-2d32288b8a8d', 'volume_name': 'volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddaf85e0-814d-4a7b-9af1-6d57c5632984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddaf85e0-814d-4a7b-9af1-6d57c5632984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982d5435-e633-4d08-9dcb-c9372fcec0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:43:58 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Volume dc85b5ef-e87f-40ee-b139-2d32288b8a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d', 'volume_size': 1} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:43:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1189528806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc85b5ef-e87f-40ee-b139-2d32288b8a8d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6cc533d550c94af7895acb064d416289',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:43:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:43:59Z,use_quota=True,user_id='8b98894058774301809160371583146d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Creating volume dc85b5ef-e87f-40ee-b139-2d32288b8a8d {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:43:58 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:43:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:58 devstack sudo[96140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 Jul 24 12:43:58 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:58 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d 1073741824 Jul 24 12:43:58 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:59 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9" returned: 0 in 0.653s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:59 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9 Jul 24 12:43:59 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:59 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d 1073741824" returned: 0 in 0.697s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:59 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Jul 24 12:43:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06255b5b-bb2a-4339-8ef2-d6129c10f5f9" returned: 0 in 0.308s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:43:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Lock "cinder-quobyte-06255b5b-bb2a-4339-8ef2-d6129c10f5f9" released by "delete_volume" :: held 1.087s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:43:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:43:59 devstack sudo[96175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d Jul 24 12:43:59 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:43:59 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Created reservations ['f7c81751-b769-4692-8d12-8cac4ce21a11'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:43:59 devstack cinder-volume[88540]: WARNING cinder.quota [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1337949068 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1337949068, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:43:59 devstack cinder-volume[88540]: WARNING cinder.quota [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1337949068 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1337949068, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:43:59 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Created reservations ['23d366a0-7784-4bb5-acb7-435bcf50ce58', 'd37359f8-3beb-4108-84ed-c8c774450a19', '9d311035-cb85-4bd0-bafe-d72fc058781e', '191d1ca6-7101-447f-b6be-46bd2b3048f1'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:00 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:44:00 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:00 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d" returned: 0 in 0.437s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982d5435-e633-4d08-9dcb-c9372fcec0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b88e3c3-7f45-447c-ab3a-bc65e8a94c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:00 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Volume volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d (dc85b5ef-e87f-40ee-b139-2d32288b8a8d): created successfully Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b88e3c3-7f45-447c-ab3a-bc65e8a94c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Flow 'volume_create_manager' (c41c0e16-ba89-4a00-a892-1f569a150462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:00 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-012a5634-0eb5-4d6d-874c-97fc59339ab4 req-09180b41-5e2e-468c-888b-d9d5e30ad9a2 tempest-VolumesGetTestJSON-1914020432 None] Created volume successfully. Jul 24 12:44:00 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.380s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:00 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:44:00 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-29c567e0-57c4-4e39-932d-b15c7e4a8701 tempest-GroupsTest-599987216 None] Delete group completed successfully. Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] Created reservations ['7abc2727-5d6c-4a89-822a-e677722e36db'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:01 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:44:01 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Acquiring lock "cinder-dc85b5ef-e87f-40ee-b139-2d32288b8a8d-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Lock "cinder-dc85b5ef-e87f-40ee-b139-2d32288b8a8d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Acquiring lock "cinder-quobyte-dc85b5ef-e87f-40ee-b139-2d32288b8a8d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Lock "cinder-quobyte-dc85b5ef-e87f-40ee-b139-2d32288b8a8d" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe450556-3082-4f14-b184-000ded34662d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:02 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.623s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:02 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:44:02 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3346252e-904c-4828-86ca-7fe82ee09505 tempest-GroupsTest-599987216 None] Delete group completed successfully. Jul 24 12:44:02 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d Jul 24 12:44:02 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:02 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d" returned: 0 in 0.727s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:02 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d Jul 24 12:44:02 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-843a7a32-000f-45c8-9cb8-59a3b263580e tempest-GroupsTest-599987216 None] Group tempest-GroupsTest-Group-583313616: creating Jul 24 12:44:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-843a7a32-000f-45c8-9cb8-59a3b263580e tempest-GroupsTest-599987216 None] Group tempest-GroupsTest-Group-583313616: created successfully Jul 24 12:44:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-843a7a32-000f-45c8-9cb8-59a3b263580e tempest-GroupsTest-599987216 None] Create group completed successfully. Jul 24 12:44:03 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dc85b5ef-e87f-40ee-b139-2d32288b8a8d" returned: 0 in 0.526s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Lock "cinder-quobyte-dc85b5ef-e87f-40ee-b139-2d32288b8a8d" released by "delete_volume" :: held 1.352s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG cinder.quota [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Created reservations ['28af508a-b80b-4eeb-84d3-1b85e948a3e0', '4f23f7ae-26bd-4651-8900-64f591fcd1c4', 'b5f6f6ad-e03c-41d9-aac6-4e6b27164170', '3ba24ee4-077c-4e48-ab82-8a9bc3fdaadb'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:03 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:44:03 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:03 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.330s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG cinder.manager [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:44:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Deleted volume successfully. Jul 24 12:44:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-78323b0c-cb43-41a1-9fd5-edc9ac7c9b2d req-8b809bb6-d8ef-41ef-800a-ed3544c9c775 tempest-VolumesGetTestJSON-1914020432 None] Lock "cinder-dc85b5ef-e87f-40ee-b139-2d32288b8a8d-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Flow 'volume_create_manager' (1657985b-93dd-45f3-85ad-f9f3abc79f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d585dce-b21e-4b4b-8556-e67206b9a152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d585dce-b21e-4b4b-8556-e67206b9a152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-110723026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8188671d-f79d-46d3-b6c2-7566054759e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291b542edea941ef975f2255b4e41bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:05Z,use_quota=True,user_id='a0bdca0e06154fe88259a2b55830c2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb53e23-7cb3-4dad-88f5-3053fdea9a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb53e23-7cb3-4dad-88f5-3053fdea9a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea35f55-83b2-4832-b22d-29b844ec2319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea35f55-83b2-4832-b22d-29b844ec2319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8188671d-f79d-46d3-b6c2-7566054759e5', 'volume_name': 'volume-8188671d-f79d-46d3-b6c2-7566054759e5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d901e1-13f0-4d7f-827f-affeb076217b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d901e1-13f0-4d7f-827f-affeb076217b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7abae2-beb8-44a7-803d-04fcada23b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:04 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Volume 8188671d-f79d-46d3-b6c2-7566054759e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8188671d-f79d-46d3-b6c2-7566054759e5', 'volume_size': 1} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-110723026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8188671d-f79d-46d3-b6c2-7566054759e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='291b542edea941ef975f2255b4e41bef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:05Z,use_quota=True,user_id='a0bdca0e06154fe88259a2b55830c2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Creating volume 8188671d-f79d-46d3-b6c2-7566054759e5 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:44:04 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:44:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:05 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5 1073741824 Jul 24 12:44:05 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Flow 'volume_create_manager' (f3306fd0-3b1c-41ee-a215-62bbbd480a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892e1b1e-3f1a-4c5a-a94c-bed6bf4355d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892e1b1e-3f1a-4c5a-a94c-bed6bf4355d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-897332496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15f54f03-902c-4765-b6df-84a0322606a6,host='devstack@QuobyteHD#QuobyteHD',id=bb009c48-68af-46a0-943e-a16c94d8009d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7992457fc1d41368569468dbe3008d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:05Z,use_quota=True,user_id='fa3ccc3464c343ceb8a683dfbcb2df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6652b86-244e-4e34-82d3-61857aeb218f),volume_type_id=f6652b86-244e-4e34-82d3-61857aeb218f)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a324868a-dfa7-4fc8-a9a1-36abc1fcf9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a324868a-dfa7-4fc8-a9a1-36abc1fcf9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4968442d-9fcc-490a-b897-f8d8ea876da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4968442d-9fcc-490a-b897-f8d8ea876da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb009c48-68af-46a0-943e-a16c94d8009d', 'volume_name': 'volume-bb009c48-68af-46a0-943e-a16c94d8009d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb519e7d-1c51-4b3b-b20c-db67ba8e512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb519e7d-1c51-4b3b-b20c-db67ba8e512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5137ad09-7f1d-45e2-9018-7d32abc72870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:05 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Volume bb009c48-68af-46a0-943e-a16c94d8009d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb009c48-68af-46a0-943e-a16c94d8009d', 'volume_size': 1} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:05 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5 1073741824" returned: 0 in 0.484s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:05 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5 Jul 24 12:44:05 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:05 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5" returned: 0 in 0.294s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15f54f03-902c-4765-b6df-84a0322606a6,created_at=2026-07-24T10:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-897332496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15f54f03-902c-4765-b6df-84a0322606a6,host='devstack@QuobyteHD#QuobyteHD',id=bb009c48-68af-46a0-943e-a16c94d8009d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7992457fc1d41368569468dbe3008d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:05Z,use_quota=True,user_id='fa3ccc3464c343ceb8a683dfbcb2df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6652b86-244e-4e34-82d3-61857aeb218f),volume_type_id=f6652b86-244e-4e34-82d3-61857aeb218f)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Creating volume bb009c48-68af-46a0-943e-a16c94d8009d {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:44:05 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c7abae2-beb8-44a7-803d-04fcada23b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8188671d-f79d-46d3-b6c2-7566054759e5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f30f13-a07f-4070-9931-0b9733c1e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:05 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d 1073741824 Jul 24 12:44:05 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:05 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Volume volume-8188671d-f79d-46d3-b6c2-7566054759e5 (8188671d-f79d-46d3-b6c2-7566054759e5): created successfully Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59f30f13-a07f-4070-9931-0b9733c1e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Flow 'volume_create_manager' (1657985b-93dd-45f3-85ad-f9f3abc79f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:05 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cba0bbc6-2830-4ef0-b45c-b011cc223537 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Created volume successfully. Jul 24 12:44:06 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d 1073741824" returned: 0 in 0.573s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:06 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d Jul 24 12:44:06 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:06 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d" returned: 0 in 0.260s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:44:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5137ad09-7f1d-45e2-9018-7d32abc72870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb009c48-68af-46a0-943e-a16c94d8009d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a28400-15ff-4c98-87b6-7baeba158166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:06 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Volume volume-bb009c48-68af-46a0-943e-a16c94d8009d (bb009c48-68af-46a0-943e-a16c94d8009d): created successfully Jul 24 12:44:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a28400-15ff-4c98-87b6-7baeba158166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Flow 'volume_create_manager' (f3306fd0-3b1c-41ee-a215-62bbbd480a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4b3413d4-a4c3-44b2-a396-faa2e778cfe1 tempest-GroupsTest-599987216 None] Created volume successfully. Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Acquiring lock "cinder-8188671d-f79d-46d3-b6c2-7566054759e5-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "cinder-8188671d-f79d-46d3-b6c2-7566054759e5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Flow 'volume_create_manager' (63d86a75-c84a-407c-9a4e-6bb6dc80907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbac4ad9-02a5-45c9-b9f9-0911b3b50b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Acquiring lock "cinder-quobyte-8188671d-f79d-46d3-b6c2-7566054759e5" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbac4ad9-02a5-45c9-b9f9-0911b3b50b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1989819000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15f54f03-902c-4765-b6df-84a0322606a6,host='devstack@QuobyteHD#QuobyteHD',id=d736feb1-c519-49e1-a0e0-da69301cf2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7992457fc1d41368569468dbe3008d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:08Z,use_quota=True,user_id='fa3ccc3464c343ceb8a683dfbcb2df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6652b86-244e-4e34-82d3-61857aeb218f),volume_type_id=f6652b86-244e-4e34-82d3-61857aeb218f)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9d7edf-fa04-4bf8-9d08-9d210e5c5f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9d7edf-fa04-4bf8-9d08-9d210e5c5f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193484cc-c64b-4e81-86a0-cae4c0ed3723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193484cc-c64b-4e81-86a0-cae4c0ed3723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd736feb1-c519-49e1-a0e0-da69301cf2b9', 'volume_name': 'volume-d736feb1-c519-49e1-a0e0-da69301cf2b9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d423e998-a418-4f4e-b712-fc9a7f2ec91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d423e998-a418-4f4e-b712-fc9a7f2ec91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c514455-dc97-476b-8f16-5dccf742aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:08 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Volume d736feb1-c519-49e1-a0e0-da69301cf2b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d736feb1-c519-49e1-a0e0-da69301cf2b9', 'volume_size': 1} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15f54f03-902c-4765-b6df-84a0322606a6,created_at=2026-07-24T10:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1989819000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15f54f03-902c-4765-b6df-84a0322606a6,host='devstack@QuobyteHD#QuobyteHD',id=d736feb1-c519-49e1-a0e0-da69301cf2b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7992457fc1d41368569468dbe3008d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:08Z,use_quota=True,user_id='fa3ccc3464c343ceb8a683dfbcb2df62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f6652b86-244e-4e34-82d3-61857aeb218f),volume_type_id=f6652b86-244e-4e34-82d3-61857aeb218f)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Creating volume d736feb1-c519-49e1-a0e0-da69301cf2b9 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:44:08 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "cinder-quobyte-8188671d-f79d-46d3-b6c2-7566054759e5" acquired by "delete_volume" :: waited 0.091s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:08 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 1073741824 Jul 24 12:44:08 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af7113a-5501-4351-9eba-13ef92644dc6]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:08 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5 Jul 24 12:44:08 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:08 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5" returned: 0 in 0.425s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:08 devstack sudo[96270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5 Jul 24 12:44:08 devstack sudo[96270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e4e03b4c-f898-4d8f-b1c9-792a60c489ea tempest-BackendsCapabilitiesAdminTestsJSON-887580709 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88540) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 12:44:08 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 1073741824" returned: 0 in 0.581s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5df4b89d-77c3-4b33-bd8f-5ce5af2b2a49 tempest-BackendsCapabilitiesAdminTestsJSON-887580709 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88540) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 12:44:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:09 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 Jul 24 12:44:09 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:09 devstack sudo[96270]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8188671d-f79d-46d3-b6c2-7566054759e5" returned: 0 in 0.372s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "cinder-quobyte-8188671d-f79d-46d3-b6c2-7566054759e5" released by "delete_volume" :: held 0.860s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=104,cinder:SELECT=100,cinder:INSERT=20,cinder:DELETE=5 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=107,cinder:UPDATE=108,cinder:INSERT=25,cinder:DELETE=5 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:44:09 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9" returned: 0 in 0.417s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Created reservations ['8b0dde7c-4d36-491c-ab26-98f0e0ff557e', 'd886a87d-5a43-4ee0-bc05-865a6f03ce88', '857c4c79-6e3a-41d6-9a36-0ca47fef3c2e', '6ef4df25-d63b-4dee-b6b4-bb5020bca884'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c514455-dc97-476b-8f16-5dccf742aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d736feb1-c519-49e1-a0e0-da69301cf2b9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96eb2cb-c338-4821-a718-91055703c689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:09 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Volume volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 (d736feb1-c519-49e1-a0e0-da69301cf2b9): created successfully Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f96eb2cb-c338-4821-a718-91055703c689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Flow 'volume_create_manager' (63d86a75-c84a-407c-9a4e-6bb6dc80907d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:09 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-37b4cbc1-3cc6-4310-b890-30782c3ea9dd tempest-GroupsTest-599987216 None] Created volume successfully. Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:09 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:44:09 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:09 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.254s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:44:09 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Deleted volume successfully. Jul 24 12:44:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb9ed1-abce-43b9-8954-651c1d85c895 tempest-VolumeQuotasNegativeTestJSON-1454164184 None] Lock "cinder-8188671d-f79d-46d3-b6c2-7566054759e5-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d92a58c5-aecd-436a-abf2-22d26f48c640 tempest-GroupsTest-599987216 None] Update group completed successfully. Jul 24 12:44:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-917980ef-f3e3-4aab-888f-c396a2110857 tempest-GroupsTest-599987216 None] Update group completed successfully. Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Acquiring lock "cinder-quobyte-bb009c48-68af-46a0-943e-a16c94d8009d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Lock "cinder-quobyte-bb009c48-68af-46a0-943e-a16c94d8009d" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8586e019-aa9b-4057-b281-dfb47ad83dbe]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:14 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d Jul 24 12:44:14 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:14 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d" returned: 0 in 0.401s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:14 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d Jul 24 12:44:14 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3a03048e-d473-4679-bc93-0e727fd18c48 tempest-GroupsV320Test-749269704 None] Group tempest-GroupsV320Test-Group-128953612: creating Jul 24 12:44:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3a03048e-d473-4679-bc93-0e727fd18c48 tempest-GroupsV320Test-749269704 None] Group tempest-GroupsV320Test-Group-128953612: created successfully Jul 24 12:44:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3a03048e-d473-4679-bc93-0e727fd18c48 tempest-GroupsV320Test-749269704 None] Create group completed successfully. Jul 24 12:44:14 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bb009c48-68af-46a0-943e-a16c94d8009d" returned: 0 in 0.273s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Lock "cinder-quobyte-bb009c48-68af-46a0-943e-a16c94d8009d" released by "delete_volume" :: held 0.735s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Acquiring lock "cinder-quobyte-d736feb1-c519-49e1-a0e0-da69301cf2b9" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Lock "cinder-quobyte-d736feb1-c519-49e1-a0e0-da69301cf2b9" acquired by "delete_volume" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7577692-68f8-4691-b81d-829260df0ecf]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:15 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 Jul 24 12:44:15 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:15 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9" returned: 0 in 0.383s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:15 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9 Jul 24 12:44:15 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:15 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d736feb1-c519-49e1-a0e0-da69301cf2b9" returned: 0 in 0.280s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:15 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Lock "cinder-quobyte-d736feb1-c519-49e1-a0e0-da69301cf2b9" released by "delete_volume" :: held 0.710s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:15 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Created reservations ['d0a7f7bb-6bcb-4b6d-88b6-67f0f639417f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:15 devstack cinder-volume[88540]: WARNING cinder.quota [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-706697660 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-706697660, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:44:15 devstack cinder-volume[88540]: WARNING cinder.quota [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-706697660 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-706697660, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:44:15 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Created reservations ['dc6e19ae-fe38-4937-8cd7-e207856a18c7', '829ffce9-d64e-4374-bdf5-80d24b10fb1a', '88294769-e997-41db-ae60-66230220dbee', '6949b6f0-b71c-4f3e-98a9-308b1c3c042d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:15 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Created reservations ['f6fa9b35-40ca-4176-8500-5cefb3e490c9', '97717a18-250e-430d-8cbc-b70ed506fb31', 'ec27c4ca-4368-47ba-9d66-ad92f0cdc2b2', '9ad6075d-e4c2-423d-a444-88ac0b256dbe'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:16 devstack sudo[96313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:44:16 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] Created reservations ['2cd932d8-016a-4236-8e0c-420fa8bc4931'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:16 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.296s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:44:16 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b9f51802-16c3-4f08-9a40-a32b0b217579 tempest-GroupsTest-599987216 None] Delete group completed successfully. Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:16 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:44:16 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Flow 'volume_create_manager' (1ae98ae4-009b-423c-9002-be759eb0bf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd401d4-d8c0-41d7-bcb9-1e30c1416230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd401d4-d8c0-41d7-bcb9-1e30c1416230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1824608815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f5ed3f-682a-412a-bd69-ff92db8322de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb081f0e5f4e4fc08ca3c93ef2ffdaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:16Z,use_quota=True,user_id='29993b6ef7f34c09803459c6b8f57514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5ec883-4167-4504-aff9-789ac066dec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e5ec883-4167-4504-aff9-789ac066dec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e160fcbe-2aac-410a-adb3-aafa801a691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e160fcbe-2aac-410a-adb3-aafa801a691f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f5ed3f-682a-412a-bd69-ff92db8322de', 'volume_name': 'volume-17f5ed3f-682a-412a-bd69-ff92db8322de', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c786a13a-8158-4767-93c4-dc8625bce8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c786a13a-8158-4767-93c4-dc8625bce8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932c4dbc-feb1-4948-88ff-7ab1e616dcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:16 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Volume 17f5ed3f-682a-412a-bd69-ff92db8322de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f5ed3f-682a-412a-bd69-ff92db8322de', 'volume_size': 1} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1824608815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f5ed3f-682a-412a-bd69-ff92db8322de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb081f0e5f4e4fc08ca3c93ef2ffdaf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:16Z,use_quota=True,user_id='29993b6ef7f34c09803459c6b8f57514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Creating volume 17f5ed3f-682a-412a-bd69-ff92db8322de {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:44:16 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:16 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de 1073741824 Jul 24 12:44:16 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:16 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.266s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:16 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:44:16 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-70d00a52-eec4-496c-b0f8-f49180f079af tempest-GroupsV320Test-749269704 None] Delete group completed successfully. Jul 24 12:44:17 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de 1073741824" returned: 0 in 0.454s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:17 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de Jul 24 12:44:17 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:17 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de" returned: 0 in 0.256s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932c4dbc-feb1-4948-88ff-7ab1e616dcab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f5ed3f-682a-412a-bd69-ff92db8322de', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4fad3b-1ab7-4bf8-a3e6-6879901d99c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:17 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Volume volume-17f5ed3f-682a-412a-bd69-ff92db8322de (17f5ed3f-682a-412a-bd69-ff92db8322de): created successfully Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4fad3b-1ab7-4bf8-a3e6-6879901d99c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Flow 'volume_create_manager' (1ae98ae4-009b-423c-9002-be759eb0bf8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:17 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6a6949e0-7061-4b25-840e-8eb154a704e6 tempest-VolumesServicesTestJSON-954380222 None] Created volume successfully. Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Acquiring lock "cinder-17f5ed3f-682a-412a-bd69-ff92db8322de-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Lock "cinder-17f5ed3f-682a-412a-bd69-ff92db8322de-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Acquiring lock "cinder-quobyte-17f5ed3f-682a-412a-bd69-ff92db8322de" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Lock "cinder-quobyte-17f5ed3f-682a-412a-bd69-ff92db8322de" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[034066dd-d14f-4358-90a9-bc7e6ccafcb8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:17 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de Jul 24 12:44:17 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:18 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de" returned: 0 in 0.380s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:18 devstack sudo[96333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de Jul 24 12:44:18 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:18 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-17f5ed3f-682a-412a-bd69-ff92db8322de" returned: 0 in 0.322s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Lock "cinder-quobyte-17f5ed3f-682a-412a-bd69-ff92db8322de" released by "delete_volume" :: held 0.767s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Created reservations ['15f2616d-3a2c-4a65-ad80-f0d6e48066b9', '66323323-7bae-428f-b030-ecca173e6def', '13ab5b8b-b998-4b41-9b34-eefcc0054f13', '16d911a5-ab4c-4c58-98d7-a367f7c7e2a8'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:18 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:44:18 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:19 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.379s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:19 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:44:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Deleted volume successfully. Jul 24 12:44:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3ae0ad4f-feed-44d1-8eab-b4cc3286f7fe tempest-VolumesServicesTestJSON-954380222 None] Lock "cinder-17f5ed3f-682a-412a-bd69-ff92db8322de-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Flow 'volume_create_manager' (92362efe-c8f5-4a03-9791-e45d45c8c82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acc43aa-22f2-42da-8972-c918bd178b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1acc43aa-22f2-42da-8972-c918bd178b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-528495438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ee3165-c605-4c77-b6a0-21655f060e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7206b5cdf844e6d9652f369cd17f571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:23Z,use_quota=True,user_id='ebacc2a2d8454823aa6ec98ed46b723a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b4020e-1e00-46e1-a352-0ed21a8aa4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b4020e-1e00-46e1-a352-0ed21a8aa4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2871f094-d87d-4594-b044-dfbdd1b50d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2871f094-d87d-4594-b044-dfbdd1b50d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ee3165-c605-4c77-b6a0-21655f060e14', 'volume_name': 'volume-67ee3165-c605-4c77-b6a0-21655f060e14', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fc5ef1-b768-44cd-8dc8-cb607c5c0155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47fc5ef1-b768-44cd-8dc8-cb607c5c0155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d15719-e077-43fc-8751-5784ba9a1928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Volume 67ee3165-c605-4c77-b6a0-21655f060e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ee3165-c605-4c77-b6a0-21655f060e14', 'volume_size': 1} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-528495438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ee3165-c605-4c77-b6a0-21655f060e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7206b5cdf844e6d9652f369cd17f571',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:23Z,use_quota=True,user_id='ebacc2a2d8454823aa6ec98ed46b723a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Creating volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:44:23 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:23 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 1073741824 Jul 24 12:44:23 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:23 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 1073741824" returned: 0 in 0.584s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:23 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 Jul 24 12:44:23 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:24 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14" returned: 0 in 0.345s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:44:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d15719-e077-43fc-8751-5784ba9a1928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ee3165-c605-4c77-b6a0-21655f060e14', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0091584c-9824-47f3-8bd6-473b2770f20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:24 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Volume volume-67ee3165-c605-4c77-b6a0-21655f060e14 (67ee3165-c605-4c77-b6a0-21655f060e14): created successfully Jul 24 12:44:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0091584c-9824-47f3-8bd6-473b2770f20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Flow 'volume_create_manager' (92362efe-c8f5-4a03-9791-e45d45c8c82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-02b3dbba-7a68-4cc0-85b6-d52834ff0557 tempest-SnapshotsActionsTest-1486704715 None] Created volume successfully. Jul 24 12:44:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Creating offline snapshot 10673c80-3d37-4574-a3cb-cec59e742493 of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:44:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ca20eb-3c31-4916-a199-4844311c9017]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:25 devstack sudo[96378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 Jul 24 12:44:25 devstack sudo[96378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:26 devstack sudo[96378]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14" returned: 0 in 0.463s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:26 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 1G Jul 24 12:44:26 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:26 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 1G" returned: 0 in 0.596s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:26 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:26 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:26 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:44:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Flow 'volume_create_manager' (0aa82e31-5b99-4c35-92a7-3d0b198c1581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7901e5a9-e1a5-4987-8777-7684effef832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7901e5a9-e1a5-4987-8777-7684effef832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1507959853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a7938b-6a67-4590-8b42-d3e6c758db06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188db4f3b1164dca87ed841c1fe36f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:27Z,use_quota=True,user_id='e15b94e9167a4f85961e616e38bbecff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c13cf9f-14d8-446b-b500-86bdaa4278b1),volume_type_id=1c13cf9f-14d8-446b-b500-86bdaa4278b1)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5933648f-a6bd-4dc6-a54e-c013ad1fb451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5933648f-a6bd-4dc6-a54e-c013ad1fb451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93037e3a-2e2c-42ce-b8af-d386ee59ce5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93037e3a-2e2c-42ce-b8af-d386ee59ce5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a7938b-6a67-4590-8b42-d3e6c758db06', 'volume_name': 'volume-a9a7938b-6a67-4590-8b42-d3e6c758db06', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1b0a29-4810-426d-80c3-c2eb5fadf1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa1b0a29-4810-426d-80c3-c2eb5fadf1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9cc8c9-9d6e-4e5c-b79d-bcab45f5a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:27 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Volume a9a7938b-6a67-4590-8b42-d3e6c758db06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a7938b-6a67-4590-8b42-d3e6c758db06', 'volume_size': 1} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:27 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.470s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:27 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 is being set with open permissions: ugo+rw Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:27 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:27 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:27 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.317s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:27 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.info Jul 24 12:44:27 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:27 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.info" returned: 0 in 0.314s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:27 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.info is being set with open permissions: ugo+rw Jul 24 12:44:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:28 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.info Jul 24 12:44:28 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:28 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.info" returned: 0 in 0.250s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.551s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.191s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1507959853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a7938b-6a67-4590-8b42-d3e6c758db06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='188db4f3b1164dca87ed841c1fe36f3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:44:27Z,use_quota=True,user_id='e15b94e9167a4f85961e616e38bbecff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c13cf9f-14d8-446b-b500-86bdaa4278b1),volume_type_id=1c13cf9f-14d8-446b-b500-86bdaa4278b1)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Creating volume a9a7938b-6a67-4590-8b42-d3e6c758db06 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:44:28 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:28 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 1073741824 Jul 24 12:44:28 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e2b05ccc-c9c3-4ad3-adb2-b1efb3706723 tempest-SnapshotsActionsTest-1486704715 None] Create snapshot completed successfully Jul 24 12:44:28 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 1073741824" returned: 0 in 0.547s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:28 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 Jul 24 12:44:28 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:29 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9cc8c9-9d6e-4e5c-b79d-bcab45f5a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a7938b-6a67-4590-8b42-d3e6c758db06', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191155aa-fc41-4306-9378-4bdfb4c8e5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:44:29 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Volume volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 (a9a7938b-6a67-4590-8b42-d3e6c758db06): created successfully Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191155aa-fc41-4306-9378-4bdfb4c8e5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Flow 'volume_create_manager' (0aa82e31-5b99-4c35-92a7-3d0b198c1581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:44:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8c612143-6fac-4746-97d6-72a53cb1942c tempest-VolumeTypesAccessTest-1908659327 None] Created volume successfully. Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Creating offline snapshot 962aa429-47eb-426c-92c8-980131b0133c of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de9b590-80ac-4b5a-84aa-09ae23453bf6]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:29 devstack sudo[96418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:29 devstack sudo[96418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:30 devstack sudo[96418]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.468s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:30 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c 1G Jul 24 12:44:30 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Acquiring lock "cinder-a9a7938b-6a67-4590-8b42-d3e6c758db06-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Lock "cinder-a9a7938b-6a67-4590-8b42-d3e6c758db06-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-903b932a-0d23-402d-8c30-673e08742003 req-5060f3d0-c5dd-4863-9911-da47cdbebdf6 tempest-AttachVolumeNegativeTest-387448775 None] Terminate volume connection completed successfully. Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-903b932a-0d23-402d-8c30-673e08742003 req-5060f3d0-c5dd-4863-9911-da47cdbebdf6 tempest-AttachVolumeNegativeTest-387448775 None] Deleting attachment 3d1b5e4a-7a37-49cf-af1b-e713ba937ec6. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Acquiring lock "cinder-quobyte-a9a7938b-6a67-4590-8b42-d3e6c758db06" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Lock "cinder-quobyte-a9a7938b-6a67-4590-8b42-d3e6c758db06" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da63ee9-4108-4834-a7e3-1bdac21a7dbc]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:30 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 Jul 24 12:44:30 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:30 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c 1G" returned: 0 in 0.628s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:30 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c Jul 24 12:44:30 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:31 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06" returned: 0 in 0.451s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:31 devstack sudo[96444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06 Jul 24 12:44:31 devstack sudo[96444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:31 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c" returned: 0 in 0.378s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:31 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c is being set with open permissions: ugo+rw Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:31 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c Jul 24 12:44:31 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:31 devstack sudo[96444]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a9a7938b-6a67-4590-8b42-d3e6c758db06" returned: 0 in 0.344s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Lock "cinder-quobyte-a9a7938b-6a67-4590-8b42-d3e6c758db06" released by "delete_volume" :: held 0.876s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:31 devstack cinder-volume[88540]: WARNING cinder.quota [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-201479304 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-201479304, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:44:31 devstack cinder-volume[88540]: WARNING cinder.quota [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-201479304 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-201479304, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Created reservations ['70bd37c6-8d1c-49f5-a387-f06b04c9d611', '4f4d9a27-4bc6-480e-ba07-3fd53cafecd7', 'e8117911-dc16-4c2e-bcdb-7fbe0348baa3', 'd2350211-18c5-47e6-a106-d9886b4ce752'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:31 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c" returned: 0 in 0.387s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:31 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:44:31 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:31 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4f409f4f-a4ce-4ce8-b0ee-b4fd80b2c76e tempest-SnapshotsActionsTest-1486704715 None] Create snapshot completed successfully Jul 24 12:44:31 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.348s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:31 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:44:31 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Deleted volume successfully. Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-464b438a-592d-4691-8d8e-6ace095676bf tempest-VolumeTypesAccessTest-1908659327 None] Lock "cinder-a9a7938b-6a67-4590-8b42-d3e6c758db06-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-962aa429-47eb-426c-92c8-980131b0133c-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-962aa429-47eb-426c-92c8-980131b0133c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-quobyte-962aa429-47eb-426c-92c8-980131b0133c" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-962aa429-47eb-426c-92c8-980131b0133c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Deleting offline snapshot 962aa429-47eb-426c-92c8-980131b0133c of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] snapshot_file for this snap is: volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[24472855-2d2e-4d3c-994e-5f9a814362f2]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:32 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c Jul 24 12:44:32 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:32 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c" returned: 0 in 0.494s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2956b398-7ca8-4ad0-94dd-6113fbb5c12b]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:33 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:33 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:33 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.521s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:33 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c Jul 24 12:44:33 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:33 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c" returned: 0 in 0.443s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:33 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c Jul 24 12:44:33 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:34 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.962aa429-47eb-426c-92c8-980131b0133c" returned: 0 in 0.436s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-962aa429-47eb-426c-92c8-980131b0133c" released by "_delete_snapshot" :: held 2.058s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" released by "delete_snapshot" :: held 2.104s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:34 devstack cinder-volume[88540]: WARNING cinder.quota [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:44:34 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Created reservations ['83ef209c-5a47-4337-9bd0-4c2172734408', '49fb2d3f-7fc2-4a76-8e37-84c9f14157a6', '9b4bf860-1290-4b93-8767-51472a74d0dd', 'd76f333c-3e86-40a6-9611-e97e939b26d5'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:34 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Delete snapshot completed successfully. Jul 24 12:44:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44f1cbcc-eca8-4518-b658-ac051bfcc796 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-962aa429-47eb-426c-92c8-980131b0133c-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Creating offline snapshot 979558f2-c830-4d64-87e4-4002aaca1e27 of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:44:35 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60d8de7-5b1a-4dd6-8a84-b27e28b783c3]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:36 devstack sudo[96503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:36 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:36 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.481s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:36 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 1G Jul 24 12:44:36 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:37 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 1G" returned: 0 in 0.691s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:37 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 Jul 24 12:44:37 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:37 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27" returned: 0 in 0.412s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:37 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 is being set with open permissions: ugo+rw Jul 24 12:44:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:37 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 Jul 24 12:44:37 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:37 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27" returned: 0 in 0.322s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.041s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6724fb97-6c0f-4adc-a52d-d828ba9a2879 tempest-SnapshotsActionsTest-1486704715 None] Create snapshot completed successfully Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-979558f2-c830-4d64-87e4-4002aaca1e27-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-979558f2-c830-4d64-87e4-4002aaca1e27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-quobyte-979558f2-c830-4d64-87e4-4002aaca1e27" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-979558f2-c830-4d64-87e4-4002aaca1e27" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Deleting offline snapshot 979558f2-c830-4d64-87e4-4002aaca1e27 of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] snapshot_file for this snap is: volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ab05bf-5ff6-4892-b02a-018438f800f9]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:39 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 Jul 24 12:44:39 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:40 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27" returned: 0 in 0.426s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:40 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[676af183-d005-4fd3-9ca8-3ac2d978c3a7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:40 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:40 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:40 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.522s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:40 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 Jul 24 12:44:40 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:41 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27" returned: 0 in 0.529s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:41 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27 Jul 24 12:44:41 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:41 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.979558f2-c830-4d64-87e4-4002aaca1e27" returned: 0 in 0.289s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-979558f2-c830-4d64-87e4-4002aaca1e27" released by "_delete_snapshot" :: held 1.901s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" released by "delete_snapshot" :: held 1.935s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:41 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Created reservations ['46c94bcc-cb44-4c57-8126-ef9aec82c556', 'a68d363e-da45-469b-8ae7-4eecaaf94d34', '9dab4710-1855-4b8c-908b-df42f8fa9298', 'c93c0ed2-5406-498e-a360-ab0199811235'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Delete snapshot completed successfully. Jul 24 12:44:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e77e2fc2-e23a-4947-b0e4-00d2a6a0c031 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-979558f2-c830-4d64-87e4-4002aaca1e27-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:42 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:44:42 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Creating offline snapshot f94c8990-d732-4747-a05e-fd1958cce7b3 of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5ceb11-722b-4215-9ceb-47544d9977df]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:42 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.463s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 8 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:44:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:44:42 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:42 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:43 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.586s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:43 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 1G Jul 24 12:44:43 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:43 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 1G" returned: 0 in 0.734s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:43 devstack sudo[96575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 Jul 24 12:44:43 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:44 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3" returned: 0 in 0.454s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:44 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 is being set with open permissions: ugo+rw Jul 24 12:44:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:44 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 Jul 24 12:44:44 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:44 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3" returned: 0 in 0.439s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5712e878-40e3-49ca-a3e9-a9d44ffcf3e0 tempest-SnapshotsActionsTest-1486704715 None] Create snapshot completed successfully Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-f94c8990-d732-4747-a05e-fd1958cce7b3-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-f94c8990-d732-4747-a05e-fd1958cce7b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-quobyte-f94c8990-d732-4747-a05e-fd1958cce7b3" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-f94c8990-d732-4747-a05e-fd1958cce7b3" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Deleting offline snapshot f94c8990-d732-4747-a05e-fd1958cce7b3 of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] snapshot_file for this snap is: volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[52337a07-5aaa-406d-b1e6-6d3d8b458284]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:46 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 Jul 24 12:44:46 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:46 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3" returned: 0 in 0.562s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:46 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[66711350-65f6-45c4-9e56-594f95b1b041]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:46 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:46 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:47 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.617s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:47 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 Jul 24 12:44:47 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:47 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3" returned: 0 in 0.656s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:47 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3 Jul 24 12:44:47 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:48 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.f94c8990-d732-4747-a05e-fd1958cce7b3" returned: 0 in 0.422s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-f94c8990-d732-4747-a05e-fd1958cce7b3" released by "_delete_snapshot" :: held 2.447s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" released by "delete_snapshot" :: held 2.478s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:48 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Created reservations ['3b566f79-e1b3-4429-8171-ccc63a82277b', '93c736fe-b127-4623-b391-46938d20e52b', '9c24b286-8ac1-4161-980e-48218a76c238', '61e1935e-fb18-4d21-8e32-54a2d955e9f2'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Delete snapshot completed successfully. Jul 24 12:44:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d11c9e5-19f5-4f9b-91e4-e569abda2c19 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-f94c8990-d732-4747-a05e-fd1958cce7b3-delete_snapshot" released by "delete_snapshot" :: held 2.730s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:44:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:44:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Creating offline snapshot 338ee3fb-304e-4f9a-9902-9e1aefee3ff0 of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:44:49 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbce8a92-211a-47e0-927f-d08ce85948e8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:49 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:49 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:50 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.847s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:50 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 1G Jul 24 12:44:50 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:51 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 1G" returned: 0 in 0.821s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:51 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 Jul 24 12:44:51 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:51 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0" returned: 0 in 0.645s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:51 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 is being set with open permissions: ugo+rw Jul 24 12:44:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:51 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 Jul 24 12:44:51 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:52 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0" returned: 0 in 0.428s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.951s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:44:52 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f77e49a5-0828-406a-a8e0-ce6c038d71e0 tempest-SnapshotsActionsTest-1486704715 None] Create snapshot completed successfully Jul 24 12:44:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-338ee3fb-304e-4f9a-9902-9e1aefee3ff0-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-338ee3fb-304e-4f9a-9902-9e1aefee3ff0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Acquiring lock "cinder-quobyte-338ee3fb-304e-4f9a-9902-9e1aefee3ff0" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-338ee3fb-304e-4f9a-9902-9e1aefee3ff0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Deleting offline snapshot 338ee3fb-304e-4f9a-9902-9e1aefee3ff0 of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:44:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] snapshot_file for this snap is: volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:44:53 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df52bc5-f151-46e2-bb96-ff00c507bba3]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:53 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 Jul 24 12:44:53 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:53 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0" returned: 0 in 0.682s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:53 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9272b2fe-cffa-447f-9fb3-aaed2e6d0a7b]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:54 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:54 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:54 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.780s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:54 devstack sudo[96764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 Jul 24 12:44:54 devstack sudo[96764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:55 devstack sudo[96764]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0" returned: 0 in 0.649s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:55 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0 Jul 24 12:44:55 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:55 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.338ee3fb-304e-4f9a-9902-9e1aefee3ff0" returned: 0 in 0.353s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-338ee3fb-304e-4f9a-9902-9e1aefee3ff0" released by "_delete_snapshot" :: held 2.647s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" released by "delete_snapshot" :: held 2.689s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:55 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Created reservations ['1bcddf73-ce17-4773-8b9a-8069f0ff0d80', '55a6e2e6-d2f6-47fc-a9d3-8db2643536f3', 'a9f4efb3-385c-4ca1-a219-b748e83d5caf', '64fb022a-a8c1-4dd2-9fbe-e9ed3b28942e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:55 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Delete snapshot completed successfully. Jul 24 12:44:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d660407a-c653-4b92-a2d1-1affef0028f1 tempest-SnapshotsActionsTest-380960932 None] Lock "cinder-338ee3fb-304e-4f9a-9902-9e1aefee3ff0-delete_snapshot" released by "delete_snapshot" :: held 2.990s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "cinder-10673c80-3d37-4574-a3cb-cec59e742493-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-10673c80-3d37-4574-a3cb-cec59e742493-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "cinder-quobyte-10673c80-3d37-4574-a3cb-cec59e742493" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-quobyte-10673c80-3d37-4574-a3cb-cec59e742493" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Deleting offline snapshot 10673c80-3d37-4574-a3cb-cec59e742493 of volume 67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] snapshot_file for this snap is: volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7988103a-db47-4acf-b906-4bdfe0dd7d72]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:57 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:57 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:57 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.424s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67ee3165-c605-4c77-b6a0-21655f060e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[47439f3f-aba9-422f-8c99-f7ebb3ba2de8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:57 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 Jul 24 12:44:57 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:57 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14" returned: 0 in 0.434s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:58 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:58 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:58 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.549s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:58 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493 Jul 24 12:44:58 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:44:58 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 24 12:44:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14.10673c80-3d37-4574-a3cb-cec59e742493" returned: 0 in 0.310s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:44:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-quobyte-10673c80-3d37-4574-a3cb-cec59e742493" released by "_delete_snapshot" :: held 1.860s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" released by "delete_snapshot" :: held 1.895s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:59 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Created reservations ['134b13a1-17ff-4d1f-a656-4f9271263ffd', '6a1ca2c0-d5db-4524-aac8-b519196eec58', '91008913-2160-4439-b940-11845fd6a9ce', '2deb0f20-1265-4ae6-9006-ba60beaaf7bc'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:44:59 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Delete snapshot completed successfully. Jul 24 12:44:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-59ea80a3-d9c9-44e6-8307-9ef64ec18dfc tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-10673c80-3d37-4574-a3cb-cec59e742493-delete_snapshot" released by "delete_snapshot" :: held 2.113s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:44:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "cinder-67ee3165-c605-4c77-b6a0-21655f060e14-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-67ee3165-c605-4c77-b6a0-21655f060e14-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:44:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:44:59 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[040ba943-7f0d-442f-901b-ec61af52ae68]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:44:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:44:59 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 Jul 24 12:44:59 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:00 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14" returned: 0 in 0.538s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:00 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14 Jul 24 12:45:00 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:00 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-67ee3165-c605-4c77-b6a0-21655f060e14" returned: 0 in 0.357s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-quobyte-67ee3165-c605-4c77-b6a0-21655f060e14" released by "delete_volume" :: held 0.973s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Created reservations ['07461759-41ea-44d5-a856-4eefe1b75728', '0d145423-c9de-4354-8f10-4f54203231c3', '6672d01e-c699-412a-84f2-c67cb6f15763', '73e68d87-87b4-4c92-bd87-b6ee57baf050'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:00 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:00 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:01 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.381s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:01 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:01 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Deleted volume successfully. Jul 24 12:45:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e37aaa55-e0a8-43cb-97c0-fa7f6f420cb7 tempest-SnapshotsActionsTest-1486704715 None] Lock "cinder-67ee3165-c605-4c77-b6a0-21655f060e14-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=103,cinder:SELECT=87,cinder:DELETE=10,cinder:INSERT=26 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=83,cinder:INSERT=24,cinder:UPDATE=95,cinder:DELETE=3 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Flow 'volume_create_manager' (3069a30e-53b6-4616-885c-5962e57193cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843f13c8-63cc-4d92-ad5b-dc845430b312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843f13c8-63cc-4d92-ad5b-dc845430b312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-921718079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9f1c33-b4c4-4076-a454-5dd95587db88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23fd6ba09d1471cbac8f17cb87bb9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:11Z,use_quota=True,user_id='2cc65bad57704a86ba73f2fb1ce36088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7942b7-03d6-4140-9503-194b172fc693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7942b7-03d6-4140-9503-194b172fc693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93b5eda-5e6b-49a5-90a1-fcdd526cbe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e93b5eda-5e6b-49a5-90a1-fcdd526cbe9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e9f1c33-b4c4-4076-a454-5dd95587db88', 'volume_name': 'volume-6e9f1c33-b4c4-4076-a454-5dd95587db88', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a11e4a3-1130-4366-aaac-5d4172fb8776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a11e4a3-1130-4366-aaac-5d4172fb8776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5ef09f-edd8-402b-92e5-4fe000a313c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:10 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Volume 6e9f1c33-b4c4-4076-a454-5dd95587db88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e9f1c33-b4c4-4076-a454-5dd95587db88', 'volume_size': 1} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-921718079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e9f1c33-b4c4-4076-a454-5dd95587db88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23fd6ba09d1471cbac8f17cb87bb9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:11Z,use_quota=True,user_id='2cc65bad57704a86ba73f2fb1ce36088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Creating volume 6e9f1c33-b4c4-4076-a454-5dd95587db88 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:10 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:10 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 1073741824 Jul 24 12:45:10 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:11 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 1073741824" returned: 0 in 0.626s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:11 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 Jul 24 12:45:11 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:11 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88" returned: 0 in 0.313s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5ef09f-edd8-402b-92e5-4fe000a313c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e9f1c33-b4c4-4076-a454-5dd95587db88', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb25451-9674-4527-8bc0-31c8881b9ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:11 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Volume volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 (6e9f1c33-b4c4-4076-a454-5dd95587db88): created successfully Jul 24 12:45:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb25451-9674-4527-8bc0-31c8881b9ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Flow 'volume_create_manager' (3069a30e-53b6-4616-885c-5962e57193cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:11 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e3ab9f18-bf7e-4a70-ae40-8a9415e2d17f tempest-VolumeQuotasAdminTestJSON-2125521362 None] Created volume successfully. Jul 24 12:45:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Acquiring lock "cinder-6e9f1c33-b4c4-4076-a454-5dd95587db88-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "cinder-6e9f1c33-b4c4-4076-a454-5dd95587db88-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Acquiring lock "cinder-quobyte-6e9f1c33-b4c4-4076-a454-5dd95587db88" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "cinder-quobyte-6e9f1c33-b4c4-4076-a454-5dd95587db88" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:12 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf5de74-23ac-4043-91d0-8c0872ca4efd]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:13 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 Jul 24 12:45:13 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:13 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88" returned: 0 in 0.437s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:13 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88 Jul 24 12:45:13 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:13 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6e9f1c33-b4c4-4076-a454-5dd95587db88" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "cinder-quobyte-6e9f1c33-b4c4-4076-a454-5dd95587db88" released by "delete_volume" :: held 0.764s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Created reservations ['914e4043-96dc-4725-b459-ed13d6559581', '7cb06635-f340-4879-839d-85dc3da1e676', '00071c75-9725-4c21-a860-3c30ccd9ab83', 'a55e6935-4ed8-4d2b-876a-f702c4328d0a'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:13 devstack sudo[96874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:13 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:14 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.370s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:14 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Deleted volume successfully. Jul 24 12:45:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8260a6eb-e256-4494-98ac-3fe892d23af5 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "cinder-6e9f1c33-b4c4-4076-a454-5dd95587db88-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:14 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Flow 'volume_create_manager' (55833c59-9dff-4997-bdb2-a4bc88ce73bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71671d42-7c3f-4e25-ab98-7d0b5dc926b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71671d42-7c3f-4e25-ab98-7d0b5dc926b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-119953602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bef5e67-3c4c-4906-a680-f9baae0df3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23fd6ba09d1471cbac8f17cb87bb9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:15Z,use_quota=True,user_id='2cc65bad57704a86ba73f2fb1ce36088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9a6649-7ff6-4006-b6e5-1ed7c58349ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9a6649-7ff6-4006-b6e5-1ed7c58349ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ad9c21-5839-44e2-b0ab-7e2f0acd3cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ad9c21-5839-44e2-b0ab-7e2f0acd3cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bef5e67-3c4c-4906-a680-f9baae0df3d6', 'volume_name': 'volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620f0317-e396-46f3-b6f1-8fee43a6025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (620f0317-e396-46f3-b6f1-8fee43a6025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce28b91e-d223-4355-817d-8d35ff8492b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:15 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Volume 6bef5e67-3c4c-4906-a680-f9baae0df3d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6', 'volume_size': 1} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-119953602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bef5e67-3c4c-4906-a680-f9baae0df3d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23fd6ba09d1471cbac8f17cb87bb9d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:15Z,use_quota=True,user_id='2cc65bad57704a86ba73f2fb1ce36088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Creating volume 6bef5e67-3c4c-4906-a680-f9baae0df3d6 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:15 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:15 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 1073741824 Jul 24 12:45:15 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:15 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 1073741824" returned: 0 in 0.896s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:16 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 Jul 24 12:45:16 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:16 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6" returned: 0 in 0.307s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce28b91e-d223-4355-817d-8d35ff8492b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316a2acc-82f4-45ed-a1be-21a621065c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:16 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Volume volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 (6bef5e67-3c4c-4906-a680-f9baae0df3d6): created successfully Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316a2acc-82f4-45ed-a1be-21a621065c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Flow 'volume_create_manager' (55833c59-9dff-4997-bdb2-a4bc88ce73bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:16 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-99b92cda-2a71-4c96-b495-d94d0e6fb631 tempest-VolumeQuotasAdminTestJSON-2125521362 None] Created volume successfully. Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Flow 'volume_create_manager' (8bc57f8b-f068-4ee8-a4e5-8856f059c408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fea871-1521-4e49-933b-82e885d01e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fea871-1521-4e49-933b-82e885d01e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-464798626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43016d47-9ec7-49a8-bf6d-a1ceccb94e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6ff75c9754b7db5d6e37701bd8f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:17Z,use_quota=True,user_id='a58f0df130f34f39b71a7f0b34b8658e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35dd2902-1efa-4bdc-b0dd-e6bfc6b45471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35dd2902-1efa-4bdc-b0dd-e6bfc6b45471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea97527f-bf36-4359-b35d-c2ac04e0a769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea97527f-bf36-4359-b35d-c2ac04e0a769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43016d47-9ec7-49a8-bf6d-a1ceccb94e5b', 'volume_name': 'volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d489dd-83d6-4b28-ac69-dc22d629689c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d489dd-83d6-4b28-ac69-dc22d629689c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250d49cc-d959-4d72-9a41-ef4c9dff3ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:16 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Volume 43016d47-9ec7-49a8-bf6d-a1ceccb94e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b', 'volume_size': 1} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-464798626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43016d47-9ec7-49a8-bf6d-a1ceccb94e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6ff75c9754b7db5d6e37701bd8f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:17Z,use_quota=True,user_id='a58f0df130f34f39b71a7f0b34b8658e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Creating volume 43016d47-9ec7-49a8-bf6d-a1ceccb94e5b {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:16 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:16 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b 1073741824 Jul 24 12:45:16 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:17 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b 1073741824" returned: 0 in 0.756s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:17 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b Jul 24 12:45:17 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:17 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b" returned: 0 in 0.339s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250d49cc-d959-4d72-9a41-ef4c9dff3ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92050e03-5528-4272-a7be-45022b77d9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:18 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Volume volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b (43016d47-9ec7-49a8-bf6d-a1ceccb94e5b): created successfully Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92050e03-5528-4272-a7be-45022b77d9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Flow 'volume_create_manager' (8bc57f8b-f068-4ee8-a4e5-8856f059c408) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-150ee34e-64f3-4504-9000-1c5f2b1ded35 tempest-AttachVolumeNegativeTest-387448775 None] Created volume successfully. Jul 24 12:45:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f4aa9230-b8c1-485a-a697-c1f666703785 tempest-VolumeQuotasAdminTestJSON-1672002282 None] Transfer volume completed successfully. Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Acquiring lock "cinder-6bef5e67-3c4c-4906-a680-f9baae0df3d6-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Lock "cinder-6bef5e67-3c4c-4906-a680-f9baae0df3d6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Acquiring lock "cinder-quobyte-6bef5e67-3c4c-4906-a680-f9baae0df3d6" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Lock "cinder-quobyte-6bef5e67-3c4c-4906-a680-f9baae0df3d6" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[395f3894-9458-4810-b3f3-bf54a40e140f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:18 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 Jul 24 12:45:18 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:19 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6" returned: 0 in 0.525s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:19 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6 Jul 24 12:45:19 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (4bbd05cf-da4c-41bb-9f9b-1c10d1b95a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea2218c-808c-452b-96a8-dd9a03aaa525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ea2218c-808c-452b-96a8-dd9a03aaa525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1594761837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6bcdee-7d21-4251-bcc9-93266e836528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:19Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37816a3c-f5c0-4e0a-8401-a3e4d64a68be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37816a3c-f5c0-4e0a-8401-a3e4d64a68be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19f723c-3ec6-4013-8f3f-d70aa8088073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a19f723c-3ec6-4013-8f3f-d70aa8088073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f6bcdee-7d21-4251-bcc9-93266e836528', 'volume_name': 'volume-1f6bcdee-7d21-4251-bcc9-93266e836528', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf34eb97-aa70-4ca5-9981-239869d95e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf34eb97-aa70-4ca5-9981-239869d95e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1915d997-7bae-4c10-9830-1a1bbb52c47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Volume 1f6bcdee-7d21-4251-bcc9-93266e836528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f6bcdee-7d21-4251-bcc9-93266e836528', 'volume_size': 1} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1594761837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f6bcdee-7d21-4251-bcc9-93266e836528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:19Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Creating volume 1f6bcdee-7d21-4251-bcc9-93266e836528 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:19 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:19 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bef5e67-3c4c-4906-a680-f9baae0df3d6" returned: 0 in 0.359s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Lock "cinder-quobyte-6bef5e67-3c4c-4906-a680-f9baae0df3d6" released by "delete_volume" :: held 0.961s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:19 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528 1073741824 Jul 24 12:45:19 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Created reservations ['c41aa167-758e-4b47-b00c-aef42fb8fe9c', 'a86d4909-86fb-4c95-9747-39d8f17a8e28', 'effd1e18-4772-44e0-be5e-b1eba00a52da', 'd8165517-96e5-41d7-bf42-be41e54b56c3'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:20 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:20 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:20 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.372s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:20 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Deleted volume successfully. Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-06800257-d979-452c-9601-1b624bfbd8b8 tempest-VolumeQuotasAdminTestJSON-216675689 None] Lock "cinder-6bef5e67-3c4c-4906-a680-f9baae0df3d6-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:20 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528 1073741824" returned: 0 in 0.799s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Flow 'volume_create_manager' (81468ea9-8a5a-4b18-b967-e3aea62dba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:20 devstack sudo[97001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528 Jul 24 12:45:20 devstack sudo[97001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50da58c-46bc-4519-9b81-e91e74cb0aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50da58c-46bc-4519-9b81-e91e74cb0aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1760379283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2764a6-0632-4668-8da0-a8c64c647de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b055c1337d414a09a90d4b041321e54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:21Z,use_quota=True,user_id='bada59ed86c4496c8ca667933304a776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea26910-3695-4971-acae-673d6cc287c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea26910-3695-4971-acae-673d6cc287c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c185c2-66af-43b7-835d-6bd535e8979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c185c2-66af-43b7-835d-6bd535e8979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a2764a6-0632-4668-8da0-a8c64c647de4', 'volume_name': 'volume-7a2764a6-0632-4668-8da0-a8c64c647de4', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4175499-3c10-4d92-83cd-c38c2277c930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4175499-3c10-4d92-83cd-c38c2277c930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1723ddb-ecaf-467e-a40b-8963029b1f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:20 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Volume 7a2764a6-0632-4668-8da0-a8c64c647de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a2764a6-0632-4668-8da0-a8c64c647de4', 'volume_size': 1} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-ed4382f7-1eff-473d-9701-35f947c5c431 req-1a5113fa-7c1c-4749-8c9a-5e3185eb7c12 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:20 devstack sudo[97001]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528" returned: 0 in 0.377s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.161s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1760379283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a2764a6-0632-4668-8da0-a8c64c647de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b055c1337d414a09a90d4b041321e54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:21Z,use_quota=True,user_id='bada59ed86c4496c8ca667933304a776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Creating volume 7a2764a6-0632-4668-8da0-a8c64c647de4 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:20 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:21 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4 1073741824 Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1915d997-7bae-4c10-9830-1a1bbb52c47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f6bcdee-7d21-4251-bcc9-93266e836528', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:21 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422f12ee-7a88-4d78-b9de-6ee8ae5d87bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:21 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Volume volume-1f6bcdee-7d21-4251-bcc9-93266e836528 (1f6bcdee-7d21-4251-bcc9-93266e836528): created successfully Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (422f12ee-7a88-4d78-b9de-6ee8ae5d87bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (4bbd05cf-da4c-41bb-9f9b-1c10d1b95a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f5f97fcc-1bd8-4147-844f-3d78b9214e6c tempest-VolumesActionsTest-111278071 None] Created volume successfully. Jul 24 12:45:21 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4 1073741824" returned: 0 in 0.452s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:21 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4 Jul 24 12:45:21 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:21 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4" returned: 0 in 0.252s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-ed4382f7-1eff-473d-9701-35f947c5c431 req-1a5113fa-7c1c-4749-8c9a-5e3185eb7c12 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.810s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2f01a90a-4ce5-4f4c-b138-026edf330c8b tempest-VolumesActionsTest-111278071 None] Acquiring lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528" by "attach_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-ed4382f7-1eff-473d-9701-35f947c5c431 req-1a5113fa-7c1c-4749-8c9a-5e3185eb7c12 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1723ddb-ecaf-467e-a40b-8963029b1f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a2764a6-0632-4668-8da0-a8c64c647de4', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8b2556-22ea-4a5e-8494-3d5efd3addcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2f01a90a-4ce5-4f4c-b138-026edf330c8b tempest-VolumesActionsTest-111278071 None] Lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528" acquired by "attach_volume" :: waited 0.044s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:21 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Volume volume-7a2764a6-0632-4668-8da0-a8c64c647de4 (7a2764a6-0632-4668-8da0-a8c64c647de4): created successfully Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8b2556-22ea-4a5e-8494-3d5efd3addcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Flow 'volume_create_manager' (81468ea9-8a5a-4b18-b967-e3aea62dba72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-07f06a0a-b14e-433f-a44a-c05c66f2b3d2 tempest-VolumesListAdminTestJSON-53411695 None] Created volume successfully. Jul 24 12:45:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-ed4382f7-1eff-473d-9701-35f947c5c431 req-1a5113fa-7c1c-4749-8c9a-5e3185eb7c12 tempest-AttachVolumeNegativeTest-387448775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c69e0da-d45d-417a-ad51-c88e3e2c4b13', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:45:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2f01a90a-4ce5-4f4c-b138-026edf330c8b tempest-VolumesActionsTest-111278071 None] Attaching volume 1f6bcdee-7d21-4251-bcc9-93266e836528 to instance 5e3f41ba-c977-46fc-beac-5d932adbfada at mountpoint /dev/vdb on host None. Jul 24 12:45:22 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-ed4382f7-1eff-473d-9701-35f947c5c431 req-1a5113fa-7c1c-4749-8c9a-5e3185eb7c12 tempest-AttachVolumeNegativeTest-387448775 None] attachment_update completed successfully. Jul 24 12:45:22 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2f01a90a-4ce5-4f4c-b138-026edf330c8b tempest-VolumesActionsTest-111278071 None] Attach volume completed successfully. Jul 24 12:45:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2f01a90a-4ce5-4f4c-b138-026edf330c8b tempest-VolumesActionsTest-111278071 None] Lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528" released by "attach_volume" :: held 0.218s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6548cfad-a88f-496c-aa60-fdb4b846435f tempest-VolumesActionsTest-1066734599 None] Terminate volume connection completed successfully. Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6548cfad-a88f-496c-aa60-fdb4b846435f tempest-VolumesActionsTest-1066734599 None] Acquiring lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528-detach_volume" by "detach_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6548cfad-a88f-496c-aa60-fdb4b846435f tempest-VolumesActionsTest-1066734599 None] Lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6548cfad-a88f-496c-aa60-fdb4b846435f tempest-VolumesActionsTest-1066734599 None] Detaching volume 1f6bcdee-7d21-4251-bcc9-93266e836528 from instance 5e3f41ba-c977-46fc-beac-5d932adbfada. Jul 24 12:45:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6548cfad-a88f-496c-aa60-fdb4b846435f tempest-VolumesActionsTest-1066734599 None] Detach volume completed successfully. Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6548cfad-a88f-496c-aa60-fdb4b846435f tempest-VolumesActionsTest-1066734599 None] Lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Flow 'volume_create_manager' (8e203f78-795c-4cbf-9915-5b42e664458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be5e1bb-2a96-4cd8-9820-d2c62d497b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be5e1bb-2a96-4cd8-9820-d2c62d497b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1665169573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf5597b-3c6d-4c6c-abd9-0914ab26ff62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b055c1337d414a09a90d4b041321e54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:23Z,use_quota=True,user_id='bada59ed86c4496c8ca667933304a776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a722a8f6-8e2b-42e5-b0f8-3592c0f9812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a722a8f6-8e2b-42e5-b0f8-3592c0f9812e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b275cd-ff5f-41ad-be4a-7b08eface6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0b275cd-ff5f-41ad-be4a-7b08eface6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf5597b-3c6d-4c6c-abd9-0914ab26ff62', 'volume_name': 'volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9084c29e-02f5-4938-a181-e930f073aa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9084c29e-02f5-4938-a181-e930f073aa5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608c1118-ed44-402c-8ae5-0a2ada7bac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Volume 2cf5597b-3c6d-4c6c-abd9-0914ab26ff62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62', 'volume_size': 1} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1665169573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf5597b-3c6d-4c6c-abd9-0914ab26ff62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b055c1337d414a09a90d4b041321e54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:23Z,use_quota=True,user_id='bada59ed86c4496c8ca667933304a776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Creating volume 2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:23 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:23 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 1073741824 Jul 24 12:45:23 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1d028c08-64ca-40a6-80ae-a9d3a80448ef tempest-VolumesActionsTest-111278071 None] Acquiring lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528-detach_volume" by "detach_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1d028c08-64ca-40a6-80ae-a9d3a80448ef tempest-VolumesActionsTest-111278071 None] Lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1d028c08-64ca-40a6-80ae-a9d3a80448ef tempest-VolumesActionsTest-111278071 None] Volume detach called, but volume not attached. Jul 24 12:45:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1d028c08-64ca-40a6-80ae-a9d3a80448ef tempest-VolumesActionsTest-111278071 None] Lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Acquiring lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Acquiring lock "cinder-quobyte-1f6bcdee-7d21-4251-bcc9-93266e836528" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Lock "cinder-quobyte-1f6bcdee-7d21-4251-bcc9-93266e836528" acquired by "delete_volume" :: waited 0.040s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:24 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b377a1-1bde-48fe-9ed9-aa1d02dd615e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:24 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 1073741824" returned: 0 in 0.861s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:24 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528 Jul 24 12:45:24 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:24 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 Jul 24 12:45:24 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:25 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62" returned: 0 in 0.431s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608c1118-ed44-402c-8ae5-0a2ada7bac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e240ed8a-93a4-455c-badc-5e9b9434bda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:25 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:25 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Volume volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 (2cf5597b-3c6d-4c6c-abd9-0914ab26ff62): created successfully Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e240ed8a-93a4-455c-badc-5e9b9434bda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Flow 'volume_create_manager' (8e203f78-795c-4cbf-9915-5b42e664458a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528" returned: 0 in 0.719s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c723c834-46ee-4cfc-9965-ed68b0ecbd6a tempest-VolumesListAdminTestJSON-53411695 None] Created volume successfully. Jul 24 12:45:25 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528 Jul 24 12:45:25 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:25 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f6bcdee-7d21-4251-bcc9-93266e836528" returned: 0 in 0.502s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Lock "cinder-quobyte-1f6bcdee-7d21-4251-bcc9-93266e836528" released by "delete_volume" :: held 1.290s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Created reservations ['59626eeb-ae0f-42ca-b946-0dd8c4ee9b25', '15fa0891-acee-4d62-bc29-cd2139117705', 'fdfd24fe-d484-483b-92dc-ea06137c1b1f', 'd6b17966-3c12-4fbc-b886-55aa3c15e37b'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-d3b1317f-7827-44b0-8487-293646c1e2af req-8680080e-8ce6-40b9-8578-29e09792f93f tempest-AttachVolumeNegativeTest-387448775 None] Terminate volume connection completed successfully. Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-d3b1317f-7827-44b0-8487-293646c1e2af req-8680080e-8ce6-40b9-8578-29e09792f93f tempest-AttachVolumeNegativeTest-387448775 None] Deleting attachment 6c69e0da-d45d-417a-ad51-c88e3e2c4b13. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:25 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:25 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:26 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.393s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Deleted volume successfully. Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a486a173-2b2b-4ce3-baa3-60927937e06d tempest-VolumesActionsTest-111278071 None] Lock "cinder-1f6bcdee-7d21-4251-bcc9-93266e836528-delete_volume" released by "delete_volume" :: held 2.168s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Flow 'volume_create_manager' (f6223096-4eaa-4e53-b0f6-de6bd19aeab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fd6fcf-08fc-43f0-b8b7-8f039555f466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fd6fcf-08fc-43f0-b8b7-8f039555f466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1401099616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dbc415-8a94-4c6b-8d61-4cd141e69ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b055c1337d414a09a90d4b041321e54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:27Z,use_quota=True,user_id='bada59ed86c4496c8ca667933304a776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed268e1b-9a08-4510-b719-ff8eac3ef02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed268e1b-9a08-4510-b719-ff8eac3ef02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86373ff3-77d6-467f-8e80-6cb173e743af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86373ff3-77d6-467f-8e80-6cb173e743af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36dbc415-8a94-4c6b-8d61-4cd141e69ae5', 'volume_name': 'volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aeb9f4a-c369-4206-98af-adde14e6df6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aeb9f4a-c369-4206-98af-adde14e6df6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb089dc-1b67-4906-81e3-6e8f923bfa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:26 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Volume 36dbc415-8a94-4c6b-8d61-4cd141e69ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5', 'volume_size': 1} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1401099616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36dbc415-8a94-4c6b-8d61-4cd141e69ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b055c1337d414a09a90d4b041321e54e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:27Z,use_quota=True,user_id='bada59ed86c4496c8ca667933304a776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Creating volume 36dbc415-8a94-4c6b-8d61-4cd141e69ae5 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:26 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:26 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 1073741824 Jul 24 12:45:26 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:27 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 1073741824" returned: 0 in 0.888s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:27 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 Jul 24 12:45:27 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:28 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5" returned: 0 in 0.343s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.303s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb089dc-1b67-4906-81e3-6e8f923bfa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc6a4e6-82cd-4307-9b90-1cc4e6a7f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:28 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Volume volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 (36dbc415-8a94-4c6b-8d61-4cd141e69ae5): created successfully Jul 24 12:45:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc6a4e6-82cd-4307-9b90-1cc4e6a7f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Flow 'volume_create_manager' (f6223096-4eaa-4e53-b0f6-de6bd19aeab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-13fd6cbe-a63b-4cf2-869f-65549228f30c tempest-VolumesListAdminTestJSON-53411695 None] Created volume successfully. Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Flow 'volume_create_manager' (6223d7c8-c6ac-4433-8ffb-c4e47fb03b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53210a85-6528-4ca8-92ad-a2377fbbc4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53210a85-6528-4ca8-92ad-a2377fbbc4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d3be06-b055-4726-b596-a10e20dd665c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c24ab9d4d1b417c8fadf44b39873a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:30Z,use_quota=True,user_id='3ee57b2c4303425890e3bde0d60d7c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f34e207-1ee5-4724-82dc-780830fddc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f34e207-1ee5-4724-82dc-780830fddc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bed769-d5ec-4806-82fd-36e50c336826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bed769-d5ec-4806-82fd-36e50c336826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d3be06-b055-4726-b596-a10e20dd665c', 'volume_name': 'volume-30d3be06-b055-4726-b596-a10e20dd665c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5c147d-112e-4914-bf0d-2018f257a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5c147d-112e-4914-bf0d-2018f257a473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb2a721-71fd-4232-9d9e-f16e8f167272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:30 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Volume 30d3be06-b055-4726-b596-a10e20dd665c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d3be06-b055-4726-b596-a10e20dd665c', 'volume_size': 1} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d3be06-b055-4726-b596-a10e20dd665c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c24ab9d4d1b417c8fadf44b39873a70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:30Z,use_quota=True,user_id='3ee57b2c4303425890e3bde0d60d7c4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Creating volume 30d3be06-b055-4726-b596-a10e20dd665c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:30 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:30 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c 1073741824 Jul 24 12:45:30 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:30 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c 1073741824" returned: 0 in 0.561s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:30 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c Jul 24 12:45:30 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:31 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c" returned: 0 in 0.394s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb2a721-71fd-4232-9d9e-f16e8f167272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d3be06-b055-4726-b596-a10e20dd665c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f77de54-849c-449d-b6a2-ffcace28e931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:31 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Volume volume-30d3be06-b055-4726-b596-a10e20dd665c (30d3be06-b055-4726-b596-a10e20dd665c): created successfully Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f77de54-849c-449d-b6a2-ffcace28e931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Flow 'volume_create_manager' (6223d7c8-c6ac-4433-8ffb-c4e47fb03b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:31 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3253262f-6fa8-489c-99bd-18d6ec471423 tempest-VolumesListAdminTestJSON-1685167781 None] Created volume successfully. Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (9fe79a60-2322-4fb7-bc09-003c30ab9644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b428a187-752a-489b-8f79-eeed816e9742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b428a187-752a-489b-8f79-eeed816e9742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302263357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:31Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8342240-f349-4d06-a6c1-dadbb01d0e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8342240-f349-4d06-a6c1-dadbb01d0e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f83335-2371-4f9f-b128-7f94ee0bd45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f83335-2371-4f9f-b128-7f94ee0bd45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f', 'volume_name': 'volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573a2e59-d686-46d3-8a83-6fe35444eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573a2e59-d686-46d3-8a83-6fe35444eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a165fe7b-b07b-432c-b019-42ee0474af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:31 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Volume a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f', 'volume_size': 1} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302263357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:31Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Creating volume a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:31 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:31 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f 1073741824 Jul 24 12:45:31 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f 1073741824" returned: 0 in 0.529s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:31 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:32 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f Jul 24 12:45:32 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:32 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f" returned: 0 in 0.318s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a165fe7b-b07b-432c-b019-42ee0474af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb763322-ee6b-4156-80ad-ddcf503ecad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Acquiring lock "cinder-30d3be06-b055-4726-b596-a10e20dd665c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:32 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Volume volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f (a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f): created successfully Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb763322-ee6b-4156-80ad-ddcf503ecad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (9fe79a60-2322-4fb7-bc09-003c30ab9644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "cinder-30d3be06-b055-4726-b596-a10e20dd665c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-61676a11-3fce-4412-ac2e-3e9d5e1a7ffc tempest-VolumesActionsTest-111278071 None] Created volume successfully. Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Acquiring lock "cinder-quobyte-30d3be06-b055-4726-b596-a10e20dd665c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "cinder-quobyte-30d3be06-b055-4726-b596-a10e20dd665c" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d4e671-215a-44eb-a277-7f015a0b6bbf]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "cinder-36dbc415-8a94-4c6b-8d61-4cd141e69ae5-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-36dbc415-8a94-4c6b-8d61-4cd141e69ae5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "cinder-quobyte-36dbc415-8a94-4c6b-8d61-4cd141e69ae5" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-quobyte-36dbc415-8a94-4c6b-8d61-4cd141e69ae5" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efc2f05-6028-4489-961b-dd2882147a01]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:32 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c Jul 24 12:45:32 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:32 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 Jul 24 12:45:32 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:32 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c" returned: 0 in 0.427s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:33 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c Jul 24 12:45:33 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:33 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5" returned: 0 in 0.444s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:33 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5 Jul 24 12:45:33 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:33 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-30d3be06-b055-4726-b596-a10e20dd665c" returned: 0 in 0.331s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "cinder-quobyte-30d3be06-b055-4726-b596-a10e20dd665c" released by "delete_volume" :: held 0.819s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Created reservations ['ab03e8e5-793c-4fc7-9998-7ffdd02a7e96', '742c5770-f497-431c-9f01-973b060ea255', '071468d6-9286-472d-b22c-de8755ed300f', 'ca981868-81f4-4eaa-8f5e-212b44a8b28e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:33 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-36dbc415-8a94-4c6b-8d61-4cd141e69ae5" returned: 0 in 0.427s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-quobyte-36dbc415-8a94-4c6b-8d61-4cd141e69ae5" released by "delete_volume" :: held 0.928s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:33 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:33 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Created reservations ['851675f5-36f9-46fd-8612-78ae6fc873f5', '88b49f88-e78e-47d8-b5be-75a7aa4c19c3', '082de38e-f0d2-482d-a917-a9c3677c8d8f', 'd62359e3-00d0-4567-a813-c09cb62d8556'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Acquiring lock "cinder-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Lock "cinder-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Acquiring lock "cinder-quobyte-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Lock "cinder-quobyte-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f" acquired by "delete_volume" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0581cb88-3e59-4cb1-b27e-ad5fc4e385cc]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:34 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:34 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:34 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.391s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:34 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Deleted volume successfully. Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d942a54a-75d3-489c-b7f4-29643e879e76 tempest-VolumesListAdminTestJSON-1685167781 None] Lock "cinder-30d3be06-b055-4726-b596-a10e20dd665c-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:34 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f Jul 24 12:45:34 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:34 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.301s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:34 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Deleted volume successfully. Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f8bc61ac-7626-4ae5-954a-c4ca7ffeeb08 tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-36dbc415-8a94-4c6b-8d61-4cd141e69ae5-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:34 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f" returned: 0 in 0.537s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:34 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f Jul 24 12:45:34 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:34 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f" returned: 0 in 0.272s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Lock "cinder-quobyte-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f" released by "delete_volume" :: held 0.882s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Created reservations ['ef43dda3-cd6b-411a-b368-5a03de784fdb', 'bbac55aa-e915-4f61-b3d8-22599482e711', '3f45a9b8-30f7-43c8-bbf8-65f1201df891', '73297f57-5cea-4b07-b892-b0eeba6fd8e2'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "cinder-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "cinder-quobyte-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-quobyte-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62" acquired by "delete_volume" :: waited 0.039s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:35 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:35 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d10de1-d366-4069-8a2a-73056b2b4b86]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:35 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 Jul 24 12:45:35 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:35 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.328s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:35 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Deleted volume successfully. Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d3a780bd-a718-4660-b8f7-8b8907edf6eb tempest-VolumesActionsTest-1066734599 None] Lock "cinder-a80b9220-a8e9-484f-a4a4-8cef7f8ffc5f-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:35 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62" returned: 0 in 0.437s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:35 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62 Jul 24 12:45:35 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:35 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62" returned: 0 in 0.252s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-quobyte-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62" released by "delete_volume" :: held 0.738s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:35 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Created reservations ['29a4cb77-c21b-43dd-83f5-f69f7bdb0dd8', 'e686af7b-e7a2-49bc-854d-4532a6ec3199', '8c340f82-3cd9-451e-a170-8fa44290b8b5', 'd5aa9362-7ff6-4570-84ab-cd6ee6e716c4'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:36 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:36 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "cinder-7a2764a6-0632-4668-8da0-a8c64c647de4-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-7a2764a6-0632-4668-8da0-a8c64c647de4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:36 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.399s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "cinder-quobyte-7a2764a6-0632-4668-8da0-a8c64c647de4" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Deleted volume successfully. Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-quobyte-7a2764a6-0632-4668-8da0-a8c64c647de4" acquired by "delete_volume" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46ccf581-1c24-414e-beeb-4ce858c84257 tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-2cf5597b-3c6d-4c6c-abd9-0914ab26ff62-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb7673-dd72-455f-8e0d-58c2389cb519]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:36 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4 Jul 24 12:45:36 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (a74a815b-7eaf-4623-b6f6-ae38dcb6c0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88861e01-da4a-43cc-86f7-65603ad46f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88861e01-da4a-43cc-86f7-65603ad46f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-918783709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9387c0a-5de0-4274-b56a-7a3594231496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:37Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203268be-8c98-4501-a17e-0f4c136ca90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203268be-8c98-4501-a17e-0f4c136ca90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b435d0-c9c3-4d5f-9ce2-000770aa4b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59b435d0-c9c3-4d5f-9ce2-000770aa4b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9387c0a-5de0-4274-b56a-7a3594231496', 'volume_name': 'volume-f9387c0a-5de0-4274-b56a-7a3594231496', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d367d1-962a-4e3f-a9c2-88bb6b3b9cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:37 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d367d1-962a-4e3f-a9c2-88bb6b3b9cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d09f4ce-4043-4c62-881a-0445e1a5efbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:37 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Volume f9387c0a-5de0-4274-b56a-7a3594231496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9387c0a-5de0-4274-b56a-7a3594231496', 'volume_size': 1} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-918783709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9387c0a-5de0-4274-b56a-7a3594231496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:37Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Creating volume f9387c0a-5de0-4274-b56a-7a3594231496 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:37 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4" returned: 0 in 0.566s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:37 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4 Jul 24 12:45:37 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:37 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496 1073741824 Jul 24 12:45:37 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:37 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7a2764a6-0632-4668-8da0-a8c64c647de4" returned: 0 in 0.317s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-quobyte-7a2764a6-0632-4668-8da0-a8c64c647de4" released by "delete_volume" :: held 0.953s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Created reservations ['110cc606-1931-4f8d-a2a5-24b14d7815c8', 'b76e9a7b-f0ac-45c8-b831-40b1d0c16ae9', '19ed1e92-35c2-40ec-82bb-1303400aaad4', '348110f6-0f0c-4e0b-8a6f-239630fa61ae'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:37 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:37 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:37 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496 1073741824" returned: 0 in 0.738s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:37 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496 Jul 24 12:45:37 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:38 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.433s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Deleted volume successfully. Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-73da1f78-77f2-4548-8682-8080a8985a7a tempest-VolumesListAdminTestJSON-53411695 None] Lock "cinder-7a2764a6-0632-4668-8da0-a8c64c647de4-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:38 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496" returned: 0 in 0.429s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d09f4ce-4043-4c62-881a-0445e1a5efbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9387c0a-5de0-4274-b56a-7a3594231496', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62c24bc-d195-4491-982f-b7ddc280c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:38 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Volume volume-f9387c0a-5de0-4274-b56a-7a3594231496 (f9387c0a-5de0-4274-b56a-7a3594231496): created successfully Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62c24bc-d195-4491-982f-b7ddc280c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (a74a815b-7eaf-4623-b6f6-ae38dcb6c0a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-59ee9236-b49b-485a-b732-ef46e5dc2786 tempest-VolumesActionsTest-111278071 None] Created volume successfully. Jul 24 12:45:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Acquiring lock "cinder-f9387c0a-5de0-4274-b56a-7a3594231496-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Lock "cinder-f9387c0a-5de0-4274-b56a-7a3594231496-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Acquiring lock "cinder-quobyte-f9387c0a-5de0-4274-b56a-7a3594231496" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Lock "cinder-quobyte-f9387c0a-5de0-4274-b56a-7a3594231496" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b5422a-0520-4c3b-92f6-918b8dca9c16]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:39 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496 Jul 24 12:45:39 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:39 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496" returned: 0 in 0.533s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:39 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496 Jul 24 12:45:39 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:40 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f9387c0a-5de0-4274-b56a-7a3594231496" returned: 0 in 0.314s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Lock "cinder-quobyte-f9387c0a-5de0-4274-b56a-7a3594231496" released by "delete_volume" :: held 0.906s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Created reservations ['73c9afa3-3dd4-46f1-8aec-ee503caa308c', 'be364385-ef7f-4f31-95a3-036972227e0c', '268541b3-6520-4044-8f00-16e1885413da', '39e3677a-0d77-4b75-8a7d-3ddb4a4139c7'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:40 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:40 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:40 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.522s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:41 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Deleted volume successfully. Jul 24 12:45:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fcab4f8-e2c8-4719-b67a-00a5e5f329e1 tempest-VolumesActionsTest-1066734599 None] Lock "cinder-f9387c0a-5de0-4274-b56a-7a3594231496-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:42 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:42 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:42 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.488s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 8 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (a49b9e33-815c-4bb2-a862-af9d3f5cab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7012743-1d75-420d-97d0-24b018be0077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7012743-1d75-420d-97d0-24b018be0077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-209574261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f5c02e-8be5-4551-96ad-a439f3555ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:43Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a125fee1-108e-4223-8b60-08b1ba55c549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a125fee1-108e-4223-8b60-08b1ba55c549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dced75ee-bb59-4800-8fd0-598e80a8028d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dced75ee-bb59-4800-8fd0-598e80a8028d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f5c02e-8be5-4551-96ad-a439f3555ae4', 'volume_name': 'volume-95f5c02e-8be5-4551-96ad-a439f3555ae4', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd371a1-29bc-4707-afb8-49321f3fcd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcd371a1-29bc-4707-afb8-49321f3fcd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04075c9-f6c9-4667-bbac-fe6c0e96fc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:43 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Volume 95f5c02e-8be5-4551-96ad-a439f3555ae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f5c02e-8be5-4551-96ad-a439f3555ae4', 'volume_size': 1} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-209574261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f5c02e-8be5-4551-96ad-a439f3555ae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:43Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Creating volume 95f5c02e-8be5-4551-96ad-a439f3555ae4 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:43 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:43 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 1073741824 Jul 24 12:45:43 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Flow 'volume_create_manager' (3c738db1-50ae-4f84-b45c-b8b651a57e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16ac9e5-d522-4433-838e-d71776009f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16ac9e5-d522-4433-838e-d71776009f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1110396110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9881896-de12-4579-832c-d6438188ea7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b516c85963ba47febddbe110c7bd8812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:43Z,use_quota=True,user_id='c86bd7af9aa542889af9fc6b0ff38580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c18faa-6324-4ee4-ab37-da870a2515bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c18faa-6324-4ee4-ab37-da870a2515bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5679d55d-2a92-4ecb-b7d5-1b1a2f5e3cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG cinder.image.glance [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Creating Keystone auth plugin from conf {{(pid=88540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 12:45:43 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 1073741824" returned: 0 in 0.812s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:43 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 Jul 24 12:45:44 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5679d55d-2a92-4ecb-b7d5-1b1a2f5e3cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e9881896-de12-4579-832c-d6438188ea7e', 'volume_name': 'volume-e9881896-de12-4579-832c-d6438188ea7e', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6c73f1-8169-440f-aaab-f1442db6a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6c73f1-8169-440f-aaab-f1442db6a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256ad910-db84-41c6-b79c-4c0ee4809f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:44 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Volume e9881896-de12-4579-832c-d6438188ea7e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e9881896-de12-4579-832c-d6438188ea7e', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Trying to clone e9881896-de12-4579-832c-d6438188ea7e from image b9bc6022-042c-4b2c-a61d-587b72521a75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]). {{(pid=88540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 12:45:44 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4" returned: 0 in 0.381s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04075c9-f6c9-4667-bbac-fe6c0e96fc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f5c02e-8be5-4551-96ad-a439f3555ae4', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd69e52-7338-4f7b-a495-0dc27e865b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:44 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Volume volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 (95f5c02e-8be5-4551-96ad-a439f3555ae4): created successfully Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd69e52-7338-4f7b-a495-0dc27e865b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (a49b9e33-815c-4bb2-a862-af9d3f5cab92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c46bdbd6-93a1-4b49-ba04-e3ac277c252a tempest-VolumesActionsTest-111278071 None] Created volume successfully. Jul 24 12:45:44 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 12:45:44 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Image download 20.69 MB at 20.69 MB/s Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f332a5-a425-485c-88fe-b1845f8700b1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Acquiring lock "cinder-95f5c02e-8be5-4551-96ad-a439f3555ae4-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Lock "cinder-95f5c02e-8be5-4551-96ad-a439f3555ae4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Acquiring lock "cinder-quobyte-95f5c02e-8be5-4551-96ad-a439f3555ae4" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Lock "cinder-quobyte-95f5c02e-8be5-4551-96ad-a439f3555ae4" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[08209efd-3fcf-433f-9350-e091ffd5a08a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:45 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD Jul 24 12:45:45 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:45 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 Jul 24 12:45:45 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:45 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD" returned: 0 in 0.698s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Temporary image b9bc6022-042c-4b2c-a61d-587b72521a75 is fetched for user c86bd7af9aa542889af9fc6b0ff38580. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ad68a-dae3-4d5d-a5c0-1879ed77eb29]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:46 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4" returned: 0 in 0.708s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:46 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4 Jul 24 12:45:46 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:46 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD Jul 24 12:45:46 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:46 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-95f5c02e-8be5-4551-96ad-a439f3555ae4" returned: 0 in 0.455s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Lock "cinder-quobyte-95f5c02e-8be5-4551-96ad-a439f3555ae4" released by "delete_volume" :: held 1.253s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Created reservations ['fa773064-64d6-49a0-bb9a-42229940aa10', '429475e7-7033-4c40-a79c-1e39260799b0', '39bf3ad8-a908-401e-ad6d-896f2e7c4b27', '4884d4f9-167a-419d-bad6-64f8d382cdae'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:46 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD" returned: 0 in 0.761s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1110396110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9881896-de12-4579-832c-d6438188ea7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b516c85963ba47febddbe110c7bd8812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:43Z,use_quota=True,user_id='c86bd7af9aa542889af9fc6b0ff38580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Creating volume e9881896-de12-4579-832c-d6438188ea7e {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:46 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:46 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e 1073741824 Jul 24 12:45:46 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:46 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:46 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:47 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.410s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:47 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:47 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Deleted volume successfully. Jul 24 12:45:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-34a2f0ef-49c6-46ee-94dd-ff780014ef36 tempest-VolumesActionsTest-1066734599 None] Lock "cinder-95f5c02e-8be5-4551-96ad-a439f3555ae4-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:47 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e 1073741824" returned: 0 in 0.791s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:47 devstack sudo[97821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e Jul 24 12:45:47 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:47 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e" returned: 0 in 0.319s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:47 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Attempting download of b9bc6022-042c-4b2c-a61d-587b72521a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}])) to volume e9881896-de12-4579-832c-d6438188ea7e. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe84b8-dd4c-4718-bbb6-6a9088a6337b]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_orl29vti {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:48 devstack sudo[97824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_orl29vti Jul 24 12:45:48 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (3f65a44d-c821-4498-b0b4-d14438295ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ec8789-4dfa-4c77-a10f-7a19dfcd20bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ec8789-4dfa-4c77-a10f-7a19dfcd20bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-89848230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3791ba-7152-45c9-a15a-6316cc1a0796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:48Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6123048f-7b2d-4426-9940-3caae2f347d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6123048f-7b2d-4426-9940-3caae2f347d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4276826-a3d1-41de-9a92-8bb4390c5c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4276826-a3d1-41de-9a92-8bb4390c5c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3791ba-7152-45c9-a15a-6316cc1a0796', 'volume_name': 'volume-9e3791ba-7152-45c9-a15a-6316cc1a0796', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2b665c-510d-4000-966d-d6692ab9323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2b665c-510d-4000-966d-d6692ab9323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d44cc83-ffd4-4a9d-a5f6-caefeb67d22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Volume 9e3791ba-7152-45c9-a15a-6316cc1a0796: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3791ba-7152-45c9-a15a-6316cc1a0796', 'volume_size': 1} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-89848230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3791ba-7152-45c9-a15a-6316cc1a0796,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:48Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Creating volume 9e3791ba-7152-45c9-a15a-6316cc1a0796 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:48 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:48 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 1073741824 Jul 24 12:45:48 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:48 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_orl29vti" returned: 0 in 0.516s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_orl29vti {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Flow 'volume_create_manager' (fc23991e-6548-47cf-a01a-bbde563bf8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4864b197-0900-4923-870f-bd1694529272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4864b197-0900-4923-870f-bd1694529272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2085776316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b26ff9-2b87-411f-9787-91c07401aa73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ecc20e140c4457a8a1891ae8032414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:49Z,use_quota=True,user_id='4e4d53237b4e4e69878f2a3c8bc5be7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab47b85-b778-47de-a7de-523f1bc2f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab47b85-b778-47de-a7de-523f1bc2f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:48 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_orl29vti Jul 24 12:45:48 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e72786-d32e-42fa-9259-0d054f44c066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e72786-d32e-42fa-9259-0d054f44c066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b26ff9-2b87-411f-9787-91c07401aa73', 'volume_name': 'volume-06b26ff9-2b87-411f-9787-91c07401aa73', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d640bb57-47a8-4c49-9122-6737a66b1429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d640bb57-47a8-4c49-9122-6737a66b1429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9e6caa-e59c-498b-92c3-cce8ca8f772b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:48 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Volume 06b26ff9-2b87-411f-9787-91c07401aa73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b26ff9-2b87-411f-9787-91c07401aa73', 'volume_size': 1} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:48 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 1073741824" returned: 0 in 0.506s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:48 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 Jul 24 12:45:48 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:48 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_orl29vti" returned: 1 in 0.387s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_orl29vti' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1a9508-636f-4195-817d-ec3d14f3bc05]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:49 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD Jul 24 12:45:49 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:49 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2085776316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b26ff9-2b87-411f-9787-91c07401aa73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ecc20e140c4457a8a1891ae8032414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:49Z,use_quota=True,user_id='4e4d53237b4e4e69878f2a3c8bc5be7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Creating volume 06b26ff9-2b87-411f-9787-91c07401aa73 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:49 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d44cc83-ffd4-4a9d-a5f6-caefeb67d22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3791ba-7152-45c9-a15a-6316cc1a0796', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:49 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73 1073741824 Jul 24 12:45:49 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ae474a-be56-4f46-8a98-99e98c71848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:49 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Volume volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 (9e3791ba-7152-45c9-a15a-6316cc1a0796): created successfully Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ae474a-be56-4f46-8a98-99e98c71848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (3f65a44d-c821-4498-b0b4-d14438295ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:49 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7e381930-a7fc-4621-a542-d8aea734f7f5 tempest-VolumesActionsTest-111278071 None] Created volume successfully. Jul 24 12:45:49 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] b9bc6022-042c-4b2c-a61d-587b72521a75 was qcow2, converting to qcow2 {{(pid=88540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:49 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e Jul 24 12:45:49 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:49 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73 1073741824" returned: 0 in 0.489s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:49 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73 Jul 24 12:45:49 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:49 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73" returned: 0 in 0.253s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9e6caa-e59c-498b-92c3-cce8ca8f772b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b26ff9-2b87-411f-9787-91c07401aa73', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c257c4aa-fff9-4e7f-847e-19c9a3cb5b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:49 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Volume volume-06b26ff9-2b87-411f-9787-91c07401aa73 (06b26ff9-2b87-411f-9787-91c07401aa73): created successfully Jul 24 12:45:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c257c4aa-fff9-4e7f-847e-19c9a3cb5b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Flow 'volume_create_manager' (fc23991e-6548-47cf-a01a-bbde563bf8a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:50 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a42691b6-65f0-4b60-b201-afd7057fe1ff tempest-VolumesTransfersV357Test-38308753 None] Created volume successfully. Jul 24 12:45:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Acquiring lock "cinder-9e3791ba-7152-45c9-a15a-6316cc1a0796-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Lock "cinder-9e3791ba-7152-45c9-a15a-6316cc1a0796-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Acquiring lock "cinder-quobyte-9e3791ba-7152-45c9-a15a-6316cc1a0796" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Lock "cinder-quobyte-9e3791ba-7152-45c9-a15a-6316cc1a0796" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:50 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[59747c7c-8a29-4167-91a1-fee514ed59f7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:50 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 Jul 24 12:45:50 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:51 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796" returned: 0 in 0.595s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:51 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796 Jul 24 12:45:51 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:51 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e" returned: 0 in 2.088s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_hzs2lfj_devstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:45:51 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Converted 112.00 MB image at 53.56 MB/s Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:51 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e 1G Jul 24 12:45:51 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:51 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9e3791ba-7152-45c9-a15a-6316cc1a0796" returned: 0 in 0.577s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Lock "cinder-quobyte-9e3791ba-7152-45c9-a15a-6316cc1a0796" released by "delete_volume" :: held 1.254s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-afa2f03a-8a44-4cc7-a5f4-4b794ffecb5c tempest-VolumesTransfersV357Test-1107831189 None] Transfer volume completed successfully. Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Created reservations ['9b63fcb5-22be-4557-a342-bcdf45cc247f', '9ca5abe9-13b6-4531-ad5f-c85e0e77003a', '1e77bd1f-899c-4223-9c77-8265d6047959', 'd3498291-7790-473b-aaa8-76bf2059d3ec'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:51 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e 1G" returned: 0 in 0.528s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Downloaded image b9bc6022-042c-4b2c-a61d-587b72521a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}])) to volume e9881896-de12-4579-832c-d6438188ea7e successfully. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Temporary image b9bc6022-042c-4b2c-a61d-587b72521a75 for user c86bd7af9aa542889af9fc6b0ff38580 is deleted. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Marking volume e9881896-de12-4579-832c-d6438188ea7e as bootable. {{(pid=88540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Copying metadata from image b9bc6022-042c-4b2c-a61d-587b72521a75 to e9881896-de12-4579-832c-d6438188ea7e. {{(pid=88540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Creating volume glance metadata for volume e9881896-de12-4579-832c-d6438188ea7e backed by image b9bc6022-042c-4b2c-a61d-587b72521a75 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:52 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:52 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256ad910-db84-41c6-b79c-4c0ee4809f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9881896-de12-4579-832c-d6438188ea7e', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8f3971-bc0b-49c6-9624-eda0853cdac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:52 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Volume volume-e9881896-de12-4579-832c-d6438188ea7e (e9881896-de12-4579-832c-d6438188ea7e): created successfully Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de8f3971-bc0b-49c6-9624-eda0853cdac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Flow 'volume_create_manager' (3c738db1-50ae-4f84-b45c-b8b651a57e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:52 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8e7952f8-0704-49b2-af79-146bda823495 tempest-VolumesImageMetadata-968646094 None] Created volume successfully. Jul 24 12:45:52 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.309s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:52 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Deleted volume successfully. Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9b8b132-9db4-4e79-84df-6da9f661bf6c tempest-VolumesActionsTest-1066734599 None] Lock "cinder-9e3791ba-7152-45c9-a15a-6316cc1a0796-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Acquiring lock "cinder-06b26ff9-2b87-411f-9787-91c07401aa73-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Lock "cinder-06b26ff9-2b87-411f-9787-91c07401aa73-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Acquiring lock "cinder-quobyte-06b26ff9-2b87-411f-9787-91c07401aa73" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Lock "cinder-quobyte-06b26ff9-2b87-411f-9787-91c07401aa73" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[035e6ce4-5abb-490e-82d8-7253d08aeaf3]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:52 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73 Jul 24 12:45:52 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:52 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73" returned: 0 in 0.397s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:52 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73 Jul 24 12:45:52 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:53 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-06b26ff9-2b87-411f-9787-91c07401aa73" returned: 0 in 0.303s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Lock "cinder-quobyte-06b26ff9-2b87-411f-9787-91c07401aa73" released by "delete_volume" :: held 0.748s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Acquiring lock "cinder-e9881896-de12-4579-832c-d6438188ea7e-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Lock "cinder-e9881896-de12-4579-832c-d6438188ea7e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Created reservations ['26aefa27-2bbe-4dd6-8585-50d8daa3364d', '9f504855-1012-4a44-85e2-c1d6f4db0e24', 'c8d5c1c2-450c-4516-a89e-8f811d089c00', '36df48ea-e1f5-4e60-bcd2-d4fbf6a738a3'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Acquiring lock "cinder-quobyte-e9881896-de12-4579-832c-d6438188ea7e" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Lock "cinder-quobyte-e9881896-de12-4579-832c-d6438188ea7e" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[535ea348-e1ac-44db-b116-3f596de5aefb]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:53 devstack sudo[97898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:53 devstack sudo[97898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (531e513d-55b1-49ea-88fe-8f1a13ef5b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e89aff7-5223-4e86-a869-108af2ed8544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e89aff7-5223-4e86-a869-108af2ed8544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1951179007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b01918-1538-4a7c-a7e2-806c5c3b7977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:53Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e0805b-c879-4b6a-8a8c-d12f08407deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:53 devstack sudo[97897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e Jul 24 12:45:53 devstack sudo[97897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e0805b-c879-4b6a-8a8c-d12f08407deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777cf5c0-570c-4933-a303-da78929e7bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777cf5c0-570c-4933-a303-da78929e7bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b01918-1538-4a7c-a7e2-806c5c3b7977', 'volume_name': 'volume-21b01918-1538-4a7c-a7e2-806c5c3b7977', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae03eea-fe1e-4036-9c80-eb79585baa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eae03eea-fe1e-4036-9c80-eb79585baa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c9c0a0-f8e6-460d-a2d1-ee07ac743692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:53 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Volume 21b01918-1538-4a7c-a7e2-806c5c3b7977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b01918-1538-4a7c-a7e2-806c5c3b7977', 'volume_size': 1} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1951179007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b01918-1538-4a7c-a7e2-806c5c3b7977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70054622c70b435880e152bff56d7739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:53Z,use_quota=True,user_id='35b75711d1904dd58e08664f5d98535e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Creating volume 21b01918-1538-4a7c-a7e2-806c5c3b7977 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:53 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:53 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 1073741824 Jul 24 12:45:53 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:53 devstack sudo[97898]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.405s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Deleted volume successfully. Jul 24 12:45:53 devstack sudo[97897]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e" returned: 0 in 0.544s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:54 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-46a9daad-1fa1-46c4-bbc3-468571974201 tempest-VolumesTransfersV357Test-826234159 None] Lock "cinder-06b26ff9-2b87-411f-9787-91c07401aa73-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:54 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:45:54 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Flow 'volume_create_manager' (42daf0f6-51b2-4079-9b29-a9d08c84c2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe6f88e-2c74-4760-b5c0-aa5fc3745304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e9881896-de12-4579-832c-d6438188ea7e" returned: 0 in 0.396s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe6f88e-2c74-4760-b5c0-aa5fc3745304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1033726461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d69a0ce-f479-4f48-b6cd-df3d06909f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ecc20e140c4457a8a1891ae8032414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:54Z,use_quota=True,user_id='4e4d53237b4e4e69878f2a3c8bc5be7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd42b55-ed19-430b-aeea-b0760f2dc81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd42b55-ed19-430b-aeea-b0760f2dc81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:54 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44a79bf-f6ab-4d38-8225-bc151e96c9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44a79bf-f6ab-4d38-8225-bc151e96c9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d69a0ce-f479-4f48-b6cd-df3d06909f43', 'volume_name': 'volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142e1f08-ce6f-4abf-aa55-8d00ceddc52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (142e1f08-ce6f-4abf-aa55-8d00ceddc52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11aee6d5-9a3a-4749-bd37-bd768b9e8210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:54 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Volume 8d69a0ce-f479-4f48-b6cd-df3d06909f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43', 'volume_size': 1} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Lock "cinder-quobyte-e9881896-de12-4579-832c-d6438188ea7e" released by "delete_volume" :: held 1.061s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 1073741824" returned: 0 in 0.765s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:54 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 Jul 24 12:45:54 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Created reservations ['b7acab41-150b-4ca9-8735-43d10f69224d', 'ed01e310-6c93-4dc4-9d41-a8c80e555fff', 'a10c5c05-eb53-45c5-b7df-4551cdbec0b9', '70677304-d620-462e-8b3e-5be659cfbe4e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:54 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:54 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:54 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977" returned: 0 in 0.256s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.304s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:45:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1033726461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d69a0ce-f479-4f48-b6cd-df3d06909f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7ecc20e140c4457a8a1891ae8032414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:45:54Z,use_quota=True,user_id='4e4d53237b4e4e69878f2a3c8bc5be7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Creating volume 8d69a0ce-f479-4f48-b6cd-df3d06909f43 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:45:54 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00c9c0a0-f8e6-460d-a2d1-ee07ac743692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b01918-1538-4a7c-a7e2-806c5c3b7977', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d8b8e6-60b6-4320-b4c2-f5224f67e8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:54 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 1073741824 Jul 24 12:45:54 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:54 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Volume volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 (21b01918-1538-4a7c-a7e2-806c5c3b7977): created successfully Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1d8b8e6-60b6-4320-b4c2-f5224f67e8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Flow 'volume_create_manager' (531e513d-55b1-49ea-88fe-8f1a13ef5b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b8267dd5-7f62-43fa-b966-7b1ccc5088ec tempest-VolumesActionsTest-111278071 None] Created volume successfully. Jul 24 12:45:54 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.298s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Deleted volume successfully. Jul 24 12:45:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2b635185-571b-4e4e-9aa9-1231a83547d9 tempest-VolumesImageMetadata-968646094 None] Lock "cinder-e9881896-de12-4579-832c-d6438188ea7e-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:55 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 1073741824" returned: 0 in 0.473s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:55 devstack sudo[97927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 Jul 24 12:45:55 devstack sudo[97927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:55 devstack sudo[97927]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43" returned: 0 in 0.256s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:45:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11aee6d5-9a3a-4749-bd37-bd768b9e8210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de829c8-1143-4c90-973a-9c96c4b0a3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:45:55 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Volume volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 (8d69a0ce-f479-4f48-b6cd-df3d06909f43): created successfully Jul 24 12:45:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de829c8-1143-4c90-973a-9c96c4b0a3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:45:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Flow 'volume_create_manager' (42daf0f6-51b2-4079-9b29-a9d08c84c2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:45:55 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-80efb670-f849-460d-9372-9faeb8ca3547 tempest-VolumesTransfersV357Test-38308753 None] Created volume successfully. Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Acquiring lock "cinder-21b01918-1538-4a7c-a7e2-806c5c3b7977-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Lock "cinder-21b01918-1538-4a7c-a7e2-806c5c3b7977-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Acquiring lock "cinder-quobyte-21b01918-1538-4a7c-a7e2-806c5c3b7977" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Lock "cinder-quobyte-21b01918-1538-4a7c-a7e2-806c5c3b7977" acquired by "delete_volume" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b96e3c3-b965-4915-b631-7508d73b7541]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:56 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 Jul 24 12:45:56 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Acquiring lock "cinder-8d69a0ce-f479-4f48-b6cd-df3d06909f43-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Lock "cinder-8d69a0ce-f479-4f48-b6cd-df3d06909f43-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Acquiring lock "cinder-quobyte-8d69a0ce-f479-4f48-b6cd-df3d06909f43" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:45:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Lock "cinder-quobyte-8d69a0ce-f479-4f48-b6cd-df3d06909f43" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a20a84-dcb7-4a08-a44c-6e280c0d1fc0]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:57 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977" returned: 0 in 0.486s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:57 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977 Jul 24 12:45:57 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:57 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 Jul 24 12:45:57 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:57 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21b01918-1538-4a7c-a7e2-806c5c3b7977" returned: 0 in 0.284s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Lock "cinder-quobyte-21b01918-1538-4a7c-a7e2-806c5c3b7977" released by "delete_volume" :: held 0.838s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Created reservations ['4d9417ac-f3e4-4a29-8adb-7d033fc1f991', 'c1a1fec8-4240-437e-99fe-f9398fe6a04a', 'd3168661-01bd-432c-8069-9148d7fbff69', 'caaf2b05-b360-4f12-8628-d6780af3506f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:57 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43" returned: 0 in 0.406s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:57 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43 Jul 24 12:45:57 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:57 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:57 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:57 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d69a0ce-f479-4f48-b6cd-df3d06909f43" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Lock "cinder-quobyte-8d69a0ce-f479-4f48-b6cd-df3d06909f43" released by "delete_volume" :: held 0.711s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Created reservations ['e472cd5b-6ff6-4822-a18a-0e2bc6e91480', '3adb5d29-e2d4-4986-87c5-0470942e271e', 'bf1be12c-d8b5-4ddf-842f-c063003e2e97', '2e3379a4-50f0-482b-ac78-e2c4790cc068'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:45:57 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.295s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:57 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Deleted volume successfully. Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e17b66ed-6e88-4322-a856-3d861478ff45 tempest-VolumesActionsTest-111278071 None] Lock "cinder-21b01918-1538-4a7c-a7e2-806c5c3b7977-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:45:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:45:57 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:45:57 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:45:58 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 24 12:45:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:45:58 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:45:58 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Deleted volume successfully. Jul 24 12:45:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cc92e4a8-db2a-4678-8122-19687520370e tempest-VolumesTransfersV357Test-826234159 None] Lock "cinder-8d69a0ce-f479-4f48-b6cd-df3d06909f43-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Flow 'volume_create_manager' (f79ac022-0db1-4043-a13e-def3264cbbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f833d6-0f88-43d5-b04a-f9543ba428ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f833d6-0f88-43d5-b04a-f9543ba428ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2106800961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5530f8c2-da47-4c12-83e7-5a41c0a965ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4171a5e5be6546b485858ad675a65c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:02Z,use_quota=True,user_id='fe23de4a580649e7a03678cc5410b6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b27522-f615-49be-ad66-856f08b5b92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b27522-f615-49be-ad66-856f08b5b92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeefadb4-d476-464f-95d9-98960b352cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeefadb4-d476-464f-95d9-98960b352cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5530f8c2-da47-4c12-83e7-5a41c0a965ec', 'volume_name': 'volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eaaec9-16c9-43a2-a9aa-f5938c3b8046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07eaaec9-16c9-43a2-a9aa-f5938c3b8046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35290114-8f9e-4911-834e-626a3b2d27ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:02 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Volume 5530f8c2-da47-4c12-83e7-5a41c0a965ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec', 'volume_size': 1} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-2106800961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5530f8c2-da47-4c12-83e7-5a41c0a965ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4171a5e5be6546b485858ad675a65c3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:02Z,use_quota=True,user_id='fe23de4a580649e7a03678cc5410b6ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Creating volume 5530f8c2-da47-4c12-83e7-5a41c0a965ec {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:02 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:02 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec 1073741824 Jul 24 12:46:02 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:02 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec 1073741824" returned: 0 in 0.521s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:02 devstack sudo[97983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec Jul 24 12:46:02 devstack sudo[97983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:03 devstack sudo[97983]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec" returned: 0 in 0.344s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35290114-8f9e-4911-834e-626a3b2d27ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963d5adb-d2b6-4a01-b269-5b0723447fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:03 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Volume volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec (5530f8c2-da47-4c12-83e7-5a41c0a965ec): created successfully Jul 24 12:46:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (963d5adb-d2b6-4a01-b269-5b0723447fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Flow 'volume_create_manager' (f79ac022-0db1-4043-a13e-def3264cbbe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-dcab343a-0c01-46c8-b8b3-ec41cf38ed8e tempest-VolumesMetadataTest-561995562 None] Created volume successfully. Jul 24 12:46:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Acquiring lock "cinder-5530f8c2-da47-4c12-83e7-5a41c0a965ec-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Lock "cinder-5530f8c2-da47-4c12-83e7-5a41c0a965ec-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Acquiring lock "cinder-quobyte-5530f8c2-da47-4c12-83e7-5a41c0a965ec" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Lock "cinder-quobyte-5530f8c2-da47-4c12-83e7-5a41c0a965ec" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:05 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[901e1fee-da9d-4a7b-995a-6c328fdfbe50]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:05 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec Jul 24 12:46:05 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:06 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec" returned: 0 in 0.421s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:06 devstack sudo[97993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec Jul 24 12:46:06 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:06 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5530f8c2-da47-4c12-83e7-5a41c0a965ec" returned: 0 in 0.433s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Lock "cinder-quobyte-5530f8c2-da47-4c12-83e7-5a41c0a965ec" released by "delete_volume" :: held 0.972s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Created reservations ['c660bb45-b53f-4438-9a2a-065ad43eaf07', '9b45ffb9-7854-4c73-a676-21bf8a34b6f8', '89e60cd1-37af-4f03-9fe2-2989586001c6', '0e646528-d6c2-4992-b638-d2eac9029470'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:06 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:06 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:07 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.477s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:07 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Deleted volume successfully. Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-599b663c-421d-48f7-a15a-bfdaf6c95cef tempest-VolumesMetadataTest-561995562 None] Lock "cinder-5530f8c2-da47-4c12-83e7-5a41c0a965ec-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Flow 'volume_create_manager' (f0ab76fb-5b60-438d-8093-f4a5287db35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7d1147-244f-447b-b8f2-055a0d2a69e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7d1147-244f-447b-b8f2-055a0d2a69e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-267137187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1880e3b-ee20-404c-a762-f1d1cffa02a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6ff75c9754b7db5d6e37701bd8f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:07Z,use_quota=True,user_id='a58f0df130f34f39b71a7f0b34b8658e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e67c595-b987-49bb-9459-9bfc63594b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e67c595-b987-49bb-9459-9bfc63594b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3faf28-6b66-4a2f-8a75-2d8dec85df8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3faf28-6b66-4a2f-8a75-2d8dec85df8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1880e3b-ee20-404c-a762-f1d1cffa02a5', 'volume_name': 'volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1425e97d-6e26-4f27-9f19-e30e497e478c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1425e97d-6e26-4f27-9f19-e30e497e478c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdce734-d572-43e3-aa9f-1b436bc3d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:07 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Volume f1880e3b-ee20-404c-a762-f1d1cffa02a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5', 'volume_size': 1} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-267137187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1880e3b-ee20-404c-a762-f1d1cffa02a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdd6ff75c9754b7db5d6e37701bd8f3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:07Z,use_quota=True,user_id='a58f0df130f34f39b71a7f0b34b8658e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Creating volume f1880e3b-ee20-404c-a762-f1d1cffa02a5 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:07 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:07 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 1073741824 Jul 24 12:46:07 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:08 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 1073741824" returned: 0 in 0.681s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:08 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 Jul 24 12:46:08 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:08 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5" returned: 0 in 0.371s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdce734-d572-43e3-aa9f-1b436bc3d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad24288-9ffc-44f6-bbc4-6fe12be78801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:08 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Volume volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 (f1880e3b-ee20-404c-a762-f1d1cffa02a5): created successfully Jul 24 12:46:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad24288-9ffc-44f6-bbc4-6fe12be78801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Flow 'volume_create_manager' (f0ab76fb-5b60-438d-8093-f4a5287db35a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a6c6eb2f-a043-4998-a38c-0b874e0da651 tempest-AttachVolumeNegativeTest-387448775 None] Created volume successfully. Jul 24 12:46:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-5eb0f8d9-6beb-4549-b9d3-13b8bb37994f req-58bb36e1-291f-4453-b10d-0792c8bd8a18 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-5eb0f8d9-6beb-4549-b9d3-13b8bb37994f req-58bb36e1-291f-4453-b10d-0792c8bd8a18 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-5eb0f8d9-6beb-4549-b9d3-13b8bb37994f req-58bb36e1-291f-4453-b10d-0792c8bd8a18 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-5eb0f8d9-6beb-4549-b9d3-13b8bb37994f req-58bb36e1-291f-4453-b10d-0792c8bd8a18 tempest-AttachVolumeNegativeTest-387448775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0b06843-b15f-406e-bc3a-bf6842db2272', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:46:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-5eb0f8d9-6beb-4549-b9d3-13b8bb37994f req-58bb36e1-291f-4453-b10d-0792c8bd8a18 tempest-AttachVolumeNegativeTest-387448775 None] attachment_update completed successfully. Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=155,cinder:INSERT=40,cinder:UPDATE=184,cinder:DELETE=18 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=198,cinder:SELECT=138,cinder:INSERT=57,cinder:DELETE=16 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Flow 'volume_create_manager' (82852e33-2361-4d86-b3c1-4345d28e6426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbaf8de-32f5-43a0-b5ce-92ac8b6ab25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbaf8de-32f5-43a0-b5ce-92ac8b6ab25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1386424106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df45fd79-1a39-4741-93e1-9751dae50e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de66af9239594e3eae384a36fd549630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:12Z,use_quota=True,user_id='99e765c9dd0b44d0b3653dfce5d91839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421836cb-2165-4eaa-9717-d0d9d349c22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (421836cb-2165-4eaa-9717-d0d9d349c22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5df4bd5-638b-4710-8169-a0e8a68ac562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5df4bd5-638b-4710-8169-a0e8a68ac562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df45fd79-1a39-4741-93e1-9751dae50e46', 'volume_name': 'volume-df45fd79-1a39-4741-93e1-9751dae50e46', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23d3974-b9b8-43b6-a129-7657f9ef9dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d23d3974-b9b8-43b6-a129-7657f9ef9dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d83dc85-0048-44a9-bbb2-9ede687fa69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:12 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Volume df45fd79-1a39-4741-93e1-9751dae50e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df45fd79-1a39-4741-93e1-9751dae50e46', 'volume_size': 1} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1386424106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df45fd79-1a39-4741-93e1-9751dae50e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de66af9239594e3eae384a36fd549630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:12Z,use_quota=True,user_id='99e765c9dd0b44d0b3653dfce5d91839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Creating volume df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:12 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:12 devstack sudo[98411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 1073741824 Jul 24 12:46:12 devstack sudo[98411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Flow 'volume_create_manager' (1ffe32e6-5b1f-4e9d-9264-af847bf6792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17cc63f-8759-43f6-84d0-79155f3d3548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b17cc63f-8759-43f6-84d0-79155f3d3548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-120889009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fa08f0-d518-47e2-84c9-96e0017a4f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1616e67194452994d0dd0c411212dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:13Z,use_quota=True,user_id='2f4765cc0bf745be9f465133048b0d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed06ae5d-ac24-450d-9c20-03044de05c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed06ae5d-ac24-450d-9c20-03044de05c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd69cef-e171-4e6f-9749-1fb477d44d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd69cef-e171-4e6f-9749-1fb477d44d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91fa08f0-d518-47e2-84c9-96e0017a4f05', 'volume_name': 'volume-91fa08f0-d518-47e2-84c9-96e0017a4f05', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf19e9d-1d66-418e-a983-821b7b2b9ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf19e9d-1d66-418e-a983-821b7b2b9ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013cebe8-4862-4710-a581-54ca7463ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:13 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Volume 91fa08f0-d518-47e2-84c9-96e0017a4f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91fa08f0-d518-47e2-84c9-96e0017a4f05', 'volume_size': 1} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:13 devstack sudo[98411]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 1073741824" returned: 0 in 0.670s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:13 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 Jul 24 12:46:13 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:13 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46" returned: 0 in 0.262s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-120889009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91fa08f0-d518-47e2-84c9-96e0017a4f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a1616e67194452994d0dd0c411212dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:13Z,use_quota=True,user_id='2f4765cc0bf745be9f465133048b0d7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Creating volume 91fa08f0-d518-47e2-84c9-96e0017a4f05 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:13 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:13 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 1073741824 Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d83dc85-0048-44a9-bbb2-9ede687fa69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df45fd79-1a39-4741-93e1-9751dae50e46', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:13 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9161d90-7ae8-4ada-97cf-8de1fcf2b19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:13 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Volume volume-df45fd79-1a39-4741-93e1-9751dae50e46 (df45fd79-1a39-4741-93e1-9751dae50e46): created successfully Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9161d90-7ae8-4ada-97cf-8de1fcf2b19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Flow 'volume_create_manager' (82852e33-2361-4d86-b3c1-4345d28e6426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2d04d819-15d6-4680-ae23-23f4ccd12604 tempest-VolumesCloneTest-605666376 None] Created volume successfully. Jul 24 12:46:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-20f1c63a-f49e-4eff-937e-8c61eaaf5ded req-370a45a7-630e-479a-93e5-0199f5bdd1aa tempest-AttachVolumeNegativeTest-387448775 None] Terminate volume connection completed successfully. Jul 24 12:46:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-20f1c63a-f49e-4eff-937e-8c61eaaf5ded req-370a45a7-630e-479a-93e5-0199f5bdd1aa tempest-AttachVolumeNegativeTest-387448775 None] Deleting attachment f0b06843-b15f-406e-bc3a-bf6842db2272. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:46:14 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 1073741824" returned: 0 in 0.560s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:14 devstack sudo[98455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 Jul 24 12:46:14 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:14 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013cebe8-4862-4710-a581-54ca7463ec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91fa08f0-d518-47e2-84c9-96e0017a4f05', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c06638-e15d-4feb-84f0-93c22e83266c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:14 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Volume volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 (91fa08f0-d518-47e2-84c9-96e0017a4f05): created successfully Jul 24 12:46:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2c06638-e15d-4feb-84f0-93c22e83266c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Flow 'volume_create_manager' (1ffe32e6-5b1f-4e9d-9264-af847bf6792e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c774a774-d8d7-4805-be1c-5fb81d0558a0 tempest-AbsoluteLimitsTests-1041637309 None] Created volume successfully. Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Flow 'volume_create_manager' (50dc2eb9-2a51-404f-bcb4-23c800ecb98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885c2a4e-244e-4315-9751-fd99930fc3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885c2a4e-244e-4315-9751-fd99930fc3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-954487853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6f1473-e39c-40af-af83-08cde7158660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de66af9239594e3eae384a36fd549630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=df45fd79-1a39-4741-93e1-9751dae50e46,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:15Z,use_quota=True,user_id='99e765c9dd0b44d0b3653dfce5d91839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3650592-b6c2-40fb-a2dd-d2fc5299eca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3650592-b6c2-40fb-a2dd-d2fc5299eca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417237a6-3044-4a0c-84cd-4d3cc1ea2647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417237a6-3044-4a0c-84cd-4d3cc1ea2647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bc6f1473-e39c-40af-af83-08cde7158660', 'volume_name': 'volume-bc6f1473-e39c-40af-af83-08cde7158660', 'volume_size': 2, 'source_volid': 'df45fd79-1a39-4741-93e1-9751dae50e46', 'source_volstatus': 'available'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568d1654-5af4-4830-830e-babfa3576675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568d1654-5af4-4830-830e-babfa3576675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce015823-58f5-423f-8277-f7da1d9573bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:15 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Volume bc6f1473-e39c-40af-af83-08cde7158660: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bc6f1473-e39c-40af-af83-08cde7158660', 'volume_size': 2, 'source_volid': 'df45fd79-1a39-4741-93e1-9751dae50e46', 'source_volstatus': 'available'} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:15 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Cloning volume df45fd79-1a39-4741-93e1-9751dae50e46 to volume bc6f1473-e39c-40af-af83-08cde7158660 Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Creating offline snapshot 950c9809-8150-4e2d-8449-292f0a5cac35 of volume df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Acquiring lock "cinder-91fa08f0-d518-47e2-84c9-96e0017a4f05-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17ec582-fa7f-4106-b8bb-211f27fc6098]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Lock "cinder-91fa08f0-d518-47e2-84c9-96e0017a4f05-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Acquiring lock "cinder-quobyte-91fa08f0-d518-47e2-84c9-96e0017a4f05" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Lock "cinder-quobyte-91fa08f0-d518-47e2-84c9-96e0017a4f05" acquired by "delete_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:15 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 Jul 24 12:46:15 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9fcddf-16b8-40ee-8583-cc57920f0c25]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:15 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 Jul 24 12:46:15 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:16 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05" returned: 0 in 0.415s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:16 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46" returned: 0 in 0.612s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:16 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05 Jul 24 12:46:16 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:16 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 1G Jul 24 12:46:16 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:16 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-91fa08f0-d518-47e2-84c9-96e0017a4f05" returned: 0 in 0.410s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Lock "cinder-quobyte-91fa08f0-d518-47e2-84c9-96e0017a4f05" released by "delete_volume" :: held 0.887s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Created reservations ['b1a05552-3c62-44f1-8610-048abd0df0c3', 'c0ae3f84-cd4c-49aa-af5d-608f9a5b0dd4', '75e17f22-f73c-440f-97d6-05833ed7cc63', '550f86dc-10e8-450a-b446-a9f4dc9f5e33'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:16 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 1G" returned: 0 in 0.654s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df45fd79-1a39-4741-93e1-9751dae50e46 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:16 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:16 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:16 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df45fd79-1a39-4741-93e1-9751dae50e46 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 Jul 24 12:46:16 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:17 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.353s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:17 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:17 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Deleted volume successfully. Jul 24 12:46:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-41a7776a-a622-479a-9c38-f039bc2c49fc tempest-AbsoluteLimitsTests-1041637309 None] Lock "cinder-91fa08f0-d518-47e2-84c9-96e0017a4f05-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:17 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df45fd79-1a39-4741-93e1-9751dae50e46 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35" returned: 0 in 0.449s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:17 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 is being set with open permissions: ugo+rw Jul 24 12:46:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:17 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 Jul 24 12:46:17 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:17 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:17 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.info Jul 24 12:46:17 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:17 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.info" returned: 0 in 0.299s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:17 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.info is being set with open permissions: ugo+rw Jul 24 12:46:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:18 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.info Jul 24 12:46:18 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:18 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.info" returned: 0 in 0.306s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Acquiring lock "cinder-quobyte-bc6f1473-e39c-40af-af83-08cde7158660" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Lock "cinder-quobyte-bc6f1473-e39c-40af-af83-08cde7158660" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] snapshot: 950c9809-8150-4e2d-8449-292f0a5cac35, volume: bc6f1473-e39c-40af-af83-08cde7158660, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[440c7c21-b460-456a-a388-92318790f815]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:18 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 Jul 24 12:46:18 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:18 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35" returned: 0 in 0.544s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df45fd79-1a39-4741-93e1-9751dae50e46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d52ce6c-7967-489e-9e6a-c11a62e13941]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:19 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 Jul 24 12:46:19 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:19 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46" returned: 0 in 0.546s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:19 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 Jul 24 12:46:19 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "cinder-f1880e3b-ee20-404c-a762-f1d1cffa02a5-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-f1880e3b-ee20-404c-a762-f1d1cffa02a5-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "cinder-quobyte-f1880e3b-ee20-404c-a762-f1d1cffa02a5" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-quobyte-f1880e3b-ee20-404c-a762-f1d1cffa02a5" acquired by "delete_volume" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[db26f042-2c0f-4fb8-b3f3-fbaa56db9766]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Flow 'volume_create_manager' (f36af75f-ae86-4867-9f45-dfb12ba361a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ca74c3-b08f-4195-980d-521fd6de80b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ca74c3-b08f-4195-980d-521fd6de80b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-807708592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9177d86a-ef10-4343-929a-6afb8754d962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1385b7259554418ac63eba996a4879f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:20Z,use_quota=True,user_id='0f90202d84794773b206c62f66a7db95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5377afa-57e9-4819-889e-5cb3d1cc95dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5377afa-57e9-4819-889e-5cb3d1cc95dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c941dbb9-fa57-4338-bafa-aca774d442ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c941dbb9-fa57-4338-bafa-aca774d442ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9177d86a-ef10-4343-929a-6afb8754d962', 'volume_name': 'volume-9177d86a-ef10-4343-929a-6afb8754d962', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9823c17c-ed3a-4c80-a10b-cd5a5b659c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9823c17c-ed3a-4c80-a10b-cd5a5b659c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad730784-55f0-419f-9f59-6dc941abb7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Volume 9177d86a-ef10-4343-929a-6afb8754d962: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9177d86a-ef10-4343-929a-6afb8754d962', 'volume_size': 1} Jul 24 12:46:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:19 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 Jul 24 12:46:19 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:20 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5" returned: 0 in 0.520s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:20 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5 Jul 24 12:46:20 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:20 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f1880e3b-ee20-404c-a762-f1d1cffa02a5" returned: 0 in 0.545s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-quobyte-f1880e3b-ee20-404c-a762-f1d1cffa02a5" released by "delete_volume" :: held 1.187s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:21 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Created reservations ['097ef96c-fab7-495f-be42-e084f8a21eaa', 'dd98248e-cc3c-4389-aa74-733bd6adfaee', '0880c3d4-2d4d-4747-aed0-da9b88b3d4fd', '32c9dfa6-f609-4109-9007-b0090096d6de'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:21 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:21 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:22 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.621s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:22 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:22 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Deleted volume successfully. Jul 24 12:46:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e252f811-c9c6-43b7-847a-bcd8c9b77218 tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-f1880e3b-ee20-404c-a762-f1d1cffa02a5-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "cinder-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "cinder-quobyte-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-quobyte-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b" acquired by "delete_volume" :: waited 0.046s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:22 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6030e10a-eec1-4618-b183-61ec4a7c1ea5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:23 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b Jul 24 12:46:23 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:23 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b" returned: 0 in 1.057s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:23 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b Jul 24 12:46:23 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:24 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b" returned: 0 in 0.647s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-quobyte-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b" released by "delete_volume" :: held 1.820s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:24 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Created reservations ['d86fc966-4a92-4928-af7f-a1898e08d036', '9fe2b8b4-9d4f-49ad-80f3-95409921c8af', 'e17991e2-88d7-4ae1-808b-e2f534cb3dd4', '13ff3dcb-dc5d-4c4b-82f8-083a3bcf5258'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:24 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:24 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660" returned: 0 in 5.474s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47f182f-79ca-44a1-8d80-d59709570e53]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:25 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.362s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Deleted volume successfully. Jul 24 12:46:25 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 Jul 24 12:46:25 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e62b5990-8f67-4aad-84d1-6b1594b22206 tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-43016d47-9ec7-49a8-bf6d-a1ceccb94e5b-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "cinder-99e08b76-2c4d-4694-860f-95d29ab7f05f-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-99e08b76-2c4d-4694-860f-95d29ab7f05f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "cinder-quobyte-99e08b76-2c4d-4694-860f-95d29ab7f05f" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-quobyte-99e08b76-2c4d-4694-860f-95d29ab7f05f" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4aafa0-5bed-4917-8442-8ac3f5299955]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:25 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f Jul 24 12:46:25 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:25 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46" returned: 0 in 0.646s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:46:25 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Converted 1024.00 MB image at 187.00 MB/s Jul 24 12:46:25 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 is being set with open permissions: ugo+rw Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:25 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 Jul 24 12:46:25 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:25 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Flow 'volume_create_manager' (266ff808-72a4-48ed-acdc-84113fc7858a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dd1fbd-f2bd-40f7-8db2-0ca2dd228ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f" returned: 0 in 0.426s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dd1fbd-f2bd-40f7-8db2-0ca2dd228ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1041623895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059a2a2d-718a-4f29-85b0-192385817bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97db4c64f3d4b52ae3b433608d39e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:26Z,use_quota=True,user_id='5c6a98eb38e844e6bc50c033c6f24987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:25 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f Jul 24 12:46:25 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afef2fd-76be-403c-bcb6-c3ff7500829c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8afef2fd-76be-403c-bcb6-c3ff7500829c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad694c13-acf7-4d97-a201-1691709c0b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad694c13-acf7-4d97-a201-1691709c0b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059a2a2d-718a-4f29-85b0-192385817bb9', 'volume_name': 'volume-059a2a2d-718a-4f29-85b0-192385817bb9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16edc8b-129f-4a61-b071-833d263b116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16edc8b-129f-4a61-b071-833d263b116b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbca220c-2f73-4c20-b006-8bbde1f3a8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:25 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Volume 059a2a2d-718a-4f29-85b0-192385817bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059a2a2d-718a-4f29-85b0-192385817bb9', 'volume_size': 1} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:25 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660" returned: 0 in 0.272s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Lock "cinder-quobyte-bc6f1473-e39c-40af-af83-08cde7158660" released by "_copy_volume_from_snapshot" :: held 7.601s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Acquiring lock "cinder-quobyte-950c9809-8150-4e2d-8449-292f0a5cac35" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Lock "cinder-quobyte-950c9809-8150-4e2d-8449-292f0a5cac35" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Deleting offline snapshot 950c9809-8150-4e2d-8449-292f0a5cac35 of volume df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] snapshot_file for this snap is: volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[125dfb2a-ee38-441b-a386-c99e607682be]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:26 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-99e08b76-2c4d-4694-860f-95d29ab7f05f" returned: 0 in 0.251s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-quobyte-99e08b76-2c4d-4694-860f-95d29ab7f05f" released by "delete_volume" :: held 0.735s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:26 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 Jul 24 12:46:26 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Created reservations ['4a3019f8-21d0-42e9-876c-4756f14447f6', 'f94470c0-03f6-47eb-a672-6d1afcdebe8e', '6ed43237-152c-48da-bf73-4e42d3eb8050', 'ddbfdda4-bc69-4e80-bcae-15d9514b16ff'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:26 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:26 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:26 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35" returned: 0 in 0.381s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df45fd79-1a39-4741-93e1-9751dae50e46(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e95895-9bd2-4839-a6a6-3856db3a3192]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:26 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.260s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Deleted volume successfully. Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9c6219f9-d40f-4245-91f5-a0855478bb2f tempest-AttachVolumeNegativeTest-387448775 None] Lock "cinder-99e08b76-2c4d-4694-860f-95d29ab7f05f-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:26 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 Jul 24 12:46:26 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:26 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46" returned: 0 in 0.374s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:26 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 Jul 24 12:46:26 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:27 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35" returned: 0 in 0.335s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:27 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35 Jul 24 12:46:27 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:27 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46.950c9809-8150-4e2d-8449-292f0a5cac35" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Lock "cinder-quobyte-950c9809-8150-4e2d-8449-292f0a5cac35" released by "_delete_snapshot" :: held 1.478s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.935s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.618s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-807708592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9177d86a-ef10-4343-929a-6afb8754d962,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1385b7259554418ac63eba996a4879f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:20Z,use_quota=True,user_id='0f90202d84794773b206c62f66a7db95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Creating volume 9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:27 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:27 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 1073741824 Jul 24 12:46:27 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce015823-58f5-423f-8277-f7da1d9573bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6f1473-e39c-40af-af83-08cde7158660', 'volume_size': 2, 'source_volid': 'df45fd79-1a39-4741-93e1-9751dae50e46', 'source_volstatus': 'available'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7580ac0b-b98f-4fc8-b892-e3b94263a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:27 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Volume volume-bc6f1473-e39c-40af-af83-08cde7158660 (bc6f1473-e39c-40af-af83-08cde7158660): created successfully Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7580ac0b-b98f-4fc8-b892-e3b94263a421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Flow 'volume_create_manager' (50dc2eb9-2a51-404f-bcb4-23c800ecb98e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c2c06c5d-666b-435f-a83b-50bc5b319c75 tempest-VolumesCloneTest-605666376 None] Created volume successfully. Jul 24 12:46:27 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 1073741824" returned: 0 in 0.456s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:28 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 Jul 24 12:46:28 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:28 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962" returned: 0 in 0.253s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.390s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1041623895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059a2a2d-718a-4f29-85b0-192385817bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97db4c64f3d4b52ae3b433608d39e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:26Z,use_quota=True,user_id='5c6a98eb38e844e6bc50c033c6f24987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Creating volume 059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:28 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad730784-55f0-419f-9f59-6dc941abb7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9177d86a-ef10-4343-929a-6afb8754d962', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:28 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 1073741824 Jul 24 12:46:28 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57f9efb-691d-4a3f-8af1-e93ac068fb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:28 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Volume volume-9177d86a-ef10-4343-929a-6afb8754d962 (9177d86a-ef10-4343-929a-6afb8754d962): created successfully Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57f9efb-691d-4a3f-8af1-e93ac068fb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Flow 'volume_create_manager' (f36af75f-ae86-4867-9f45-dfb12ba361a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-43e2e47c-3b61-475e-a357-3aef7de1a2d2 tempest-VolumesActionsTest-350082901 None] Created volume successfully. Jul 24 12:46:28 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 1073741824" returned: 0 in 0.536s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:28 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 Jul 24 12:46:28 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Acquiring lock "cinder-bc6f1473-e39c-40af-af83-08cde7158660-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Lock "cinder-bc6f1473-e39c-40af-af83-08cde7158660-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Acquiring lock "cinder-quobyte-bc6f1473-e39c-40af-af83-08cde7158660" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Lock "cinder-quobyte-bc6f1473-e39c-40af-af83-08cde7158660" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2089d983-5362-4e7f-a4a7-298f27c37cbf]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:29 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9" returned: 0 in 0.294s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbca220c-2f73-4c20-b006-8bbde1f3a8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059a2a2d-718a-4f29-85b0-192385817bb9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:29 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 Jul 24 12:46:29 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9ce1f3-6ad3-48ff-b6c8-f12d78998d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:29 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Volume volume-059a2a2d-718a-4f29-85b0-192385817bb9 (059a2a2d-718a-4f29-85b0-192385817bb9): created successfully Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9ce1f3-6ad3-48ff-b6c8-f12d78998d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Flow 'volume_create_manager' (266ff808-72a4-48ed-acdc-84113fc7858a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2e020925-44da-4e2c-aae0-542a11b18035 tempest-VolumesDeleteCascade-1576032237 None] Created volume successfully. Jul 24 12:46:29 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660" returned: 0 in 0.493s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:29 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660 Jul 24 12:46:29 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:29 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bc6f1473-e39c-40af-af83-08cde7158660" returned: 0 in 0.317s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Lock "cinder-quobyte-bc6f1473-e39c-40af-af83-08cde7158660" released by "delete_volume" :: held 0.876s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Created reservations ['5e964d06-e70b-4b60-80b3-effa2f7c6a2e', '16862525-e894-4479-9ac9-2f8c3534d1c5', '577283f4-166c-4267-9744-43b7a6e2431c', '6c6e0b61-7a7b-4eb0-84cf-8dda225038ae'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:30 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:30 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Acquiring lock "cinder-df45fd79-1a39-4741-93e1-9751dae50e46-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Lock "cinder-df45fd79-1a39-4741-93e1-9751dae50e46-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Creating offline snapshot eef036be-835c-47be-aee6-6d8fcd004bb2 of volume 059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Acquiring lock "cinder-quobyte-df45fd79-1a39-4741-93e1-9751dae50e46" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6c7621-e6c0-42a9-bb3d-a5fe1410c323]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Lock "cinder-quobyte-df45fd79-1a39-4741-93e1-9751dae50e46" acquired by "delete_volume" :: waited 0.053s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdf78db-d103-4d9d-8471-8838ba5b0b9a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:30 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.511s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Deleted volume successfully. Jul 24 12:46:30 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 Jul 24 12:46:30 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:30 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 Jul 24 12:46:30 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ea0fe174-f60f-4e06-9a78-6ab4917e51f7 tempest-VolumesCloneTest-605666376 None] Lock "cinder-bc6f1473-e39c-40af-af83-08cde7158660-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:31 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46" returned: 0 in 0.508s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:31 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46 Jul 24 12:46:31 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:31 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9" returned: 0 in 0.641s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:31 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 1G Jul 24 12:46:31 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:31 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-df45fd79-1a39-4741-93e1-9751dae50e46" returned: 0 in 0.344s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Lock "cinder-quobyte-df45fd79-1a39-4741-93e1-9751dae50e46" released by "delete_volume" :: held 0.945s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Created reservations ['96aa02a4-c86b-4949-b2e5-dfacf8e55399', 'a678056d-b546-4119-aff1-a47054d1e19b', 'a758d4fe-b8cf-4968-9ae8-f65454a015af', '52fc22a4-ebb1-4c4d-a23f-6c0fc9e6bf0d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:31 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:31 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:31 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 1G" returned: 0 in 0.667s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059a2a2d-718a-4f29-85b0-192385817bb9 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:31 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059a2a2d-718a-4f29-85b0-192385817bb9 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 Jul 24 12:46:31 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:31 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.359s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:31 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Deleted volume successfully. Jul 24 12:46:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dcf86ed4-a902-47da-b4b8-e39305917438 tempest-VolumesCloneTest-605666376 None] Lock "cinder-df45fd79-1a39-4741-93e1-9751dae50e46-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:32 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059a2a2d-718a-4f29-85b0-192385817bb9 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2" returned: 0 in 0.626s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:32 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 is being set with open permissions: ugo+rw Jul 24 12:46:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:32 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 Jul 24 12:46:32 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:32 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2" returned: 0 in 0.376s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:32 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.info Jul 24 12:46:32 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:33 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.info" returned: 0 in 0.328s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:33 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.info is being set with open permissions: ugo+rw Jul 24 12:46:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:33 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.info Jul 24 12:46:33 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:33 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.info" returned: 0 in 0.312s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:33 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ac739a3c-a30e-4791-b754-acf1e9ab8d88 tempest-VolumesDeleteCascade-1576032237 None] Create snapshot completed successfully Jul 24 12:46:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Creating offline snapshot 757555a9-c659-4b11-aee0-0903ab6af934 of volume 059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac240ab-d844-4995-b578-af825b57c9f2]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:35 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 Jul 24 12:46:35 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Flow 'volume_create_manager' (9385d416-e154-4f96-bf6a-fc7054be9cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb087fc-b97f-40a1-bb17-88e40963dfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdb087fc-b97f-40a1-bb17-88e40963dfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1833266638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ada5e8-0737-4c64-bd4a-cc56ed7054b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b23d6be19b742d786158554438e4fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:35Z,use_quota=True,user_id='cb2a79aac86e4b0da59f1aa03e8a886b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5211c6f-c60b-43b8-a07c-5c445f21d27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5211c6f-c60b-43b8-a07c-5c445f21d27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c638f5a-7289-47ca-88ef-75bf589e62d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c638f5a-7289-47ca-88ef-75bf589e62d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ada5e8-0737-4c64-bd4a-cc56ed7054b0', 'volume_name': 'volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa4040d-825d-4b26-ac1f-ad96d29b9bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa4040d-825d-4b26-ac1f-ad96d29b9bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acaca26-ae52-40ae-a91f-6d692afaf51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:35 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:35 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Volume b3ada5e8-0737-4c64-bd4a-cc56ed7054b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0', 'volume_size': 1} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2" returned: 0 in 0.729s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059a2a2d-718a-4f29-85b0-192385817bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:46:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:35 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 1G Jul 24 12:46:35 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:36 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 1G" returned: 0 in 0.637s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:36 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 Jul 24 12:46:36 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:36 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934" returned: 0 in 0.362s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:36 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 is being set with open permissions: ugo+rw Jul 24 12:46:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:36 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 Jul 24 12:46:36 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:37 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934" returned: 0 in 0.344s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1833266638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ada5e8-0737-4c64-bd4a-cc56ed7054b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b23d6be19b742d786158554438e4fb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:35Z,use_quota=True,user_id='cb2a79aac86e4b0da59f1aa03e8a886b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Creating volume b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:37 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:37 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 1073741824 Jul 24 12:46:37 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:37 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ee1843a2-878e-40d5-bba4-3fc8d4c9130c tempest-VolumesDeleteCascade-1576032237 None] Create snapshot completed successfully Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Flow 'volume_create_manager' (3f2dc2d6-7ed8-4ecf-ba45-36defa846bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5fde2a-eb68-475f-8f00-2d9991f0fd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5fde2a-eb68-475f-8f00-2d9991f0fd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2027522518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252c1344-f792-48bd-a405-b00b9e9964e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673da70ffe54413696763125ce0dd48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:37Z,use_quota=True,user_id='fa26cc4cadfa4a968e7890a30c1bc04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631af3be-f1c4-475f-8548-55ca5f320a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (631af3be-f1c4-475f-8548-55ca5f320a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54d45fb-10cf-480b-84a1-62deaacbec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f54d45fb-10cf-480b-84a1-62deaacbec67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252c1344-f792-48bd-a405-b00b9e9964e1', 'volume_name': 'volume-252c1344-f792-48bd-a405-b00b9e9964e1', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c54b63d-b44a-420b-b177-b1b3ae5f5ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c54b63d-b44a-420b-b177-b1b3ae5f5ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0339b1-d938-4def-b1b9-19ce118ef597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:37 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Volume 252c1344-f792-48bd-a405-b00b9e9964e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252c1344-f792-48bd-a405-b00b9e9964e1', 'volume_size': 1} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:37 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 1073741824" returned: 0 in 0.617s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:37 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 Jul 24 12:46:37 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-059a2a2d-718a-4f29-85b0-192385817bb9-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-059a2a2d-718a-4f29-85b0-192385817bb9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Performing cascade delete. {{(pid=88540) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-757555a9-c659-4b11-aee0-0903ab6af934-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-757555a9-c659-4b11-aee0-0903ab6af934-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-059a2a2d-718a-4f29-85b0-192385817bb9" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-059a2a2d-718a-4f29-85b0-192385817bb9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-757555a9-c659-4b11-aee0-0903ab6af934" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:38 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" returned: 0 in 0.403s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.874s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2027522518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252c1344-f792-48bd-a405-b00b9e9964e1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673da70ffe54413696763125ce0dd48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:37Z,use_quota=True,user_id='fa26cc4cadfa4a968e7890a30c1bc04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Creating volume 252c1344-f792-48bd-a405-b00b9e9964e1 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:38 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-757555a9-c659-4b11-aee0-0903ab6af934" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Deleting offline snapshot 757555a9-c659-4b11-aee0-0903ab6af934 of volume 059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:46:38 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1 1073741824 Jul 24 12:46:38 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] snapshot_file for this snap is: volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acaca26-ae52-40ae-a91f-6d692afaf51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7032a3-5060-4f59-8028-497a29fbd553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fbb99f-3c34-4920-acd3-57980300a1b7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:38 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Volume volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 (b3ada5e8-0737-4c64-bd4a-cc56ed7054b0): created successfully Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7032a3-5060-4f59-8028-497a29fbd553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Flow 'volume_create_manager' (9385d416-e154-4f96-bf6a-fc7054be9cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-90f8e67d-08c2-47d2-b054-3ca887d5ea09 req-24d84874-ff0f-44f1-b2a0-a50e1d988275 tempest-VolumesSnapshotsTestJSON-1428594868 None] Created volume successfully. Jul 24 12:46:38 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 Jul 24 12:46:38 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-89f2f045-93b4-41d1-af38-44913ff67a9c tempest-VolumesActionsTest-350082901 None] Acquiring lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962" by "attach_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-89f2f045-93b4-41d1-af38-44913ff67a9c tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962" acquired by "attach_volume" :: waited 0.027s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-89f2f045-93b4-41d1-af38-44913ff67a9c tempest-VolumesActionsTest-350082901 None] Attaching volume 9177d86a-ef10-4343-929a-6afb8754d962 to instance 63d2976e-c4db-4942-af5d-23e8bac3b1d3 at mountpoint /dev/vdb on host None. Jul 24 12:46:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-89f2f045-93b4-41d1-af38-44913ff67a9c tempest-VolumesActionsTest-350082901 None] Attach volume completed successfully. Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-89f2f045-93b4-41d1-af38-44913ff67a9c tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962" released by "attach_volume" :: held 0.150s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:38 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934" returned: 0 in 0.546s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059a2a2d-718a-4f29-85b0-192385817bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7767bbd-678c-484b-ad57-825770e0a641]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:39 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1 1073741824" returned: 0 in 0.724s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0ee4d454-417c-45fd-90de-f00db1603014 tempest-VolumesActionsTest-350082901 None] Acquiring lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962-detach_volume" by "detach_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0ee4d454-417c-45fd-90de-f00db1603014 tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0ee4d454-417c-45fd-90de-f00db1603014 tempest-VolumesActionsTest-350082901 None] Detaching volume 9177d86a-ef10-4343-929a-6afb8754d962 from instance 63d2976e-c4db-4942-af5d-23e8bac3b1d3. Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:39 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 Jul 24 12:46:39 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:39 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1 Jul 24 12:46:39 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0ee4d454-417c-45fd-90de-f00db1603014 tempest-VolumesActionsTest-350082901 None] Detach volume completed successfully. Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0ee4d454-417c-45fd-90de-f00db1603014 tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962-detach_volume" released by "detach_volume" :: held 0.170s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:39 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1" returned: 0 in 0.512s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.284s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Creating offline snapshot 93299d41-2f68-46e2-8a69-852c8512adba of volume b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b0339b1-d938-4def-b1b9-19ce118ef597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252c1344-f792-48bd-a405-b00b9e9964e1', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:39 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4eee2e0-a032-4a03-a828-58d1957ab292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4363356-8a0f-4cb2-875f-e34500b89591]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2" returned: 0 in 0.747s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059a2a2d-718a-4f29-85b0-192385817bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:39 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Volume volume-252c1344-f792-48bd-a405-b00b9e9964e1 (252c1344-f792-48bd-a405-b00b9e9964e1): created successfully Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4eee2e0-a032-4a03-a828-58d1957ab292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Flow 'volume_create_manager' (3f2dc2d6-7ed8-4ecf-ba45-36defa846bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:39 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 Jul 24 12:46:39 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b1acfe7d-72cb-46c0-a401-da9b8e512384 tempest-VolumesListTestJSON-1818790177 None] Created volume successfully. Jul 24 12:46:39 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 Jul 24 12:46:39 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:40 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" returned: 0 in 0.501s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:40 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba 1G Jul 24 12:46:40 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:40 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934" returned: 0 in 0.550s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:40 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934 Jul 24 12:46:40 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:40 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.757555a9-c659-4b11-aee0-0903ab6af934" returned: 0 in 0.488s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-757555a9-c659-4b11-aee0-0903ab6af934" released by "_delete_snapshot" :: held 2.512s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-059a2a2d-718a-4f29-85b0-192385817bb9" released by "delete_snapshot" :: held 2.576s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Created reservations ['85b0bde4-cc1e-4850-a16c-135714f53b81', '969724e7-ee51-49f9-afd5-be9223a7d0bc', '7edcc22e-c599-47b5-b5b6-725add8d99a5', 'bdb63fcc-24e7-448a-927a-b60be5e0a69b'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:40 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba 1G" returned: 0 in 0.729s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:41 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba Jul 24 12:46:41 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Delete snapshot completed successfully. Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-757555a9-c659-4b11-aee0-0903ab6af934-delete_snapshot" released by "delete_snapshot" :: held 2.853s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-eef036be-835c-47be-aee6-6d8fcd004bb2-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-eef036be-835c-47be-aee6-6d8fcd004bb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-059a2a2d-718a-4f29-85b0-192385817bb9" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-059a2a2d-718a-4f29-85b0-192385817bb9" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-eef036be-835c-47be-aee6-6d8fcd004bb2" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-eef036be-835c-47be-aee6-6d8fcd004bb2" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Deleting offline snapshot eef036be-835c-47be-aee6-6d8fcd004bb2 of volume 059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] snapshot_file for this snap is: volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4766082-7658-459b-93dd-b3f378d4088e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:41 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:41 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 Jul 24 12:46:41 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Flow 'volume_create_manager' (ae1fcd3d-b653-4a9b-b156-67a6ea3239c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc608693-9d09-4c34-befc-75f2dd0c8ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba" returned: 0 in 0.541s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:41 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba is being set with open permissions: ugo+rw Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc608693-9d09-4c34-befc-75f2dd0c8ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1327410002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4dd5a6-86e4-4df2-9aec-83ca034e7b47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673da70ffe54413696763125ce0dd48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:41Z,use_quota=True,user_id='fa26cc4cadfa4a968e7890a30c1bc04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:41 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba Jul 24 12:46:41 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a361cf-7d87-40bb-9fd8-e814747c198b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a361cf-7d87-40bb-9fd8-e814747c198b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9582a7ca-5b7b-4d6f-9516-76adf7018f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9582a7ca-5b7b-4d6f-9516-76adf7018f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4dd5a6-86e4-4df2-9aec-83ca034e7b47', 'volume_name': 'volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8830763c-10b8-4b2a-9be5-3225780afc36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8830763c-10b8-4b2a-9be5-3225780afc36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (825dbcf9-a97c-4a5a-a1c3-acd0c748a11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:41 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Volume 7b4dd5a6-86e4-4df2-9aec-83ca034e7b47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47', 'volume_size': 1} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:41 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba" returned: 0 in 0.308s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:41 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2" returned: 0 in 0.580s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-059a2a2d-718a-4f29-85b0-192385817bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:46:41 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.info Jul 24 12:46:41 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[718c3f46-2e2e-4f89-9dd4-7a3e1ef3e12e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:42 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 Jul 24 12:46:42 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:42 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:42 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:42 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.info" returned: 0 in 0.317s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:42 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.info is being set with open permissions: ugo+rw Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:42 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.info Jul 24 12:46:42 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:42 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9" returned: 0 in 0.424s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:42 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 Jul 24 12:46:42 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:42 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.356s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:46:42 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.info" returned: 0 in 0.344s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.884s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.985s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1327410002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4dd5a6-86e4-4df2-9aec-83ca034e7b47,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673da70ffe54413696763125ce0dd48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:41Z,use_quota=True,user_id='fa26cc4cadfa4a968e7890a30c1bc04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Creating volume 7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:42 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:42 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 1073741824 Jul 24 12:46:42 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:42 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-d5b30492-4a1f-46db-86e2-b5397c15e3ca req-acea1697-5995-4c40-9cae-494fe2099e7b tempest-VolumesSnapshotsTestJSON-1428594868 None] Create snapshot completed successfully Jul 24 12:46:42 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2" returned: 0 in 0.426s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:42 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2 Jul 24 12:46:42 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:43 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9.eef036be-835c-47be-aee6-6d8fcd004bb2" returned: 0 in 0.278s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:43 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-eef036be-835c-47be-aee6-6d8fcd004bb2" released by "_delete_snapshot" :: held 1.857s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 1073741824" returned: 0 in 0.517s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-059a2a2d-718a-4f29-85b0-192385817bb9" released by "delete_snapshot" :: held 1.899s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:43 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 Jul 24 12:46:43 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Created reservations ['e4c06aa6-c13f-4f76-b8ac-b187b27ff8c0', '78c4df63-b06d-4e8f-adb1-0c93715da2e2', '8ce44cfb-9dc9-435c-8d46-8d870969f8d5', 'e4c1414f-4f1c-4832-82ca-1c41394935fc'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:43 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Delete snapshot completed successfully. Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-eef036be-835c-47be-aee6-6d8fcd004bb2-delete_snapshot" released by "delete_snapshot" :: held 2.118s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Snapshots deleted, issuing volume delete {{(pid=88540) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-059a2a2d-718a-4f29-85b0-192385817bb9" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-059a2a2d-718a-4f29-85b0-192385817bb9" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2e63d6-841d-4918-871f-9717bf711c2c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:43 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47" returned: 0 in 0.325s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Acquiring lock "cinder-93299d41-2f68-46e2-8a69-852c8512adba-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:43 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 Jul 24 12:46:43 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (825dbcf9-a97c-4a5a-a1c3-acd0c748a11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9f34a2-7997-4d3c-b15a-98c4e6925289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:43 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Volume volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 (7b4dd5a6-86e4-4df2-9aec-83ca034e7b47): created successfully Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9f34a2-7997-4d3c-b15a-98c4e6925289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Flow 'volume_create_manager' (ae1fcd3d-b653-4a9b-b156-67a6ea3239c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-93299d41-2f68-46e2-8a69-852c8512adba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Acquiring lock "cinder-quobyte-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:43 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4ca49a80-9469-4aa8-8bc9-6a72d276f211 tempest-VolumesListTestJSON-1818790177 None] Created volume successfully. Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-quobyte-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Acquiring lock "cinder-quobyte-93299d41-2f68-46e2-8a69-852c8512adba" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-quobyte-93299d41-2f68-46e2-8a69-852c8512adba" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Deleting offline snapshot 93299d41-2f68-46e2-8a69-852c8512adba of volume b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] snapshot_file for this snap is: volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a152da06-7fb3-4429-9aed-1a8313d65d39]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:43 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba Jul 24 12:46:43 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:43 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9" returned: 0 in 0.473s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:43 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9 Jul 24 12:46:43 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:44 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:44 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-059a2a2d-718a-4f29-85b0-192385817bb9" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba" returned: 0 in 0.410s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-059a2a2d-718a-4f29-85b0-192385817bb9" released by "delete_volume" :: held 0.839s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aef87bf-b718-49b6-aa66-88e5b29bb14a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Created reservations ['c2275283-97a6-4903-bfa3-9934f446e209', '3e43864f-43ad-4412-80b5-397bf86063ad', '076c289d-5e76-4a2f-bf15-9d7680a0c9ea', '819979f9-c8e2-469c-ab1c-55d1e4d83d3f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:44 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:44 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:44 devstack sudo[98943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:44 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:44 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:44 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" returned: 0 in 0.472s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.358s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Deleted volume successfully. Jul 24 12:46:44 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba Jul 24 12:46:44 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-971da1a9-b16b-4b7b-9e0f-a609ac7421a6 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-059a2a2d-718a-4f29-85b0-192385817bb9-delete_volume" released by "delete_volume" :: held 6.596s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:45 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba" returned: 0 in 0.545s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:45 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba Jul 24 12:46:45 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:45 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0.93299d41-2f68-46e2-8a69-852c8512adba" returned: 0 in 0.379s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-quobyte-93299d41-2f68-46e2-8a69-852c8512adba" released by "_delete_snapshot" :: held 1.944s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-quobyte-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" released by "delete_snapshot" :: held 1.981s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.quota [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Created reservations ['b7f8c705-a6b1-47ac-9e57-d34820e21940', '4c7c82e8-0fad-4ef3-b218-fd844db4c5ec', '9e308e2f-49b2-49b7-a83a-b50ac53ed05d', 'f01800c7-d3c5-4066-a2bd-684b9bb059e5'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:45 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Delete snapshot completed successfully. Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Flow 'volume_create_manager' (43a45efd-4c6b-4678-b1ce-c528a4819134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc52e22-d474-4c43-8964-c08da16c24b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-61d29429-380f-4983-8ff0-9bce9f73e933 req-409beadf-099b-44a6-956f-dc73cef91031 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-93299d41-2f68-46e2-8a69-852c8512adba-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fc52e22-d474-4c43-8964-c08da16c24b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1987044918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ab9f3e-0c58-49c7-8959-38c7f235bc0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673da70ffe54413696763125ce0dd48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:46Z,use_quota=True,user_id='fa26cc4cadfa4a968e7890a30c1bc04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8e9df7-e8f1-4ae6-9e27-3d2a5342900a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8e9df7-e8f1-4ae6-9e27-3d2a5342900a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c01bf4-fac2-4bae-a136-449f3d7b8c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c01bf4-fac2-4bae-a136-449f3d7b8c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21ab9f3e-0c58-49c7-8959-38c7f235bc0b', 'volume_name': 'volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b383f1-dcce-4ef6-8aed-460d25dbf466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b383f1-dcce-4ef6-8aed-460d25dbf466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6690b811-7319-4854-ae93-012e54eb9bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:46 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Volume 21ab9f3e-0c58-49c7-8959-38c7f235bc0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b', 'volume_size': 1} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1987044918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21ab9f3e-0c58-49c7-8959-38c7f235bc0b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='673da70ffe54413696763125ce0dd48b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:46Z,use_quota=True,user_id='fa26cc4cadfa4a968e7890a30c1bc04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Creating volume 21ab9f3e-0c58-49c7-8959-38c7f235bc0b {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:46 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Acquiring lock "cinder-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:46 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b 1073741824 Jul 24 12:46:46 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Flow 'volume_create_manager' (8afdfc84-1895-4a84-8afa-b44b8e8b3c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edeb62b-b8ae-44a8-b999-26c5cddced50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1edeb62b-b8ae-44a8-b999-26c5cddced50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1339745934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d633ad99-026d-4b76-a402-c919ceded180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97db4c64f3d4b52ae3b433608d39e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:46Z,use_quota=True,user_id='5c6a98eb38e844e6bc50c033c6f24987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7c75e7-e44e-4b9d-8850-cf51dc36eee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7c75e7-e44e-4b9d-8850-cf51dc36eee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ca6141-6de5-4bbc-8538-3c36cd2f1481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ca6141-6de5-4bbc-8538-3c36cd2f1481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd633ad99-026d-4b76-a402-c919ceded180', 'volume_name': 'volume-d633ad99-026d-4b76-a402-c919ceded180', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b285eb-208d-4f1a-8f5b-12e4feaf5e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b285eb-208d-4f1a-8f5b-12e4feaf5e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d000eb37-2f28-4506-be28-cb96aa7bb689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:46 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Volume d633ad99-026d-4b76-a402-c919ceded180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d633ad99-026d-4b76-a402-c919ceded180', 'volume_size': 1} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Acquiring lock "cinder-quobyte-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-quobyte-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a275b37f-59f5-4a98-92cb-793a2f8c054e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:46 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 Jul 24 12:46:46 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:46 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b 1073741824" returned: 0 in 0.534s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:46 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b Jul 24 12:46:46 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:46 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" returned: 0 in 0.420s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:46 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0 Jul 24 12:46:46 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:46 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b" returned: 0 in 0.261s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.643s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1339745934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d633ad99-026d-4b76-a402-c919ceded180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97db4c64f3d4b52ae3b433608d39e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:46Z,use_quota=True,user_id='5c6a98eb38e844e6bc50c033c6f24987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Creating volume d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:46 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6690b811-7319-4854-ae93-012e54eb9bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:46 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 1073741824 Jul 24 12:46:46 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416a0afd-7fc0-4413-939f-8c3b5a5e8c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:46 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Volume volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b (21ab9f3e-0c58-49c7-8959-38c7f235bc0b): created successfully Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416a0afd-7fc0-4413-939f-8c3b5a5e8c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Flow 'volume_create_manager' (43a45efd-4c6b-4678-b1ce-c528a4819134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:46 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e1c22a25-adfc-4dca-8412-82cc2676991a tempest-VolumesListTestJSON-1818790177 None] Created volume successfully. Jul 24 12:46:47 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" returned: 0 in 0.257s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-quobyte-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0" released by "delete_volume" :: held 0.748s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG cinder.quota [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Created reservations ['9cd094c9-396b-4627-a59d-c77d6ff0769b', 'c8c579af-5a41-440e-ae07-017fbdf75aad', 'ee4b035e-dd92-41af-863c-58417044d636', '3e460e79-fdd2-444c-8792-44acd6affa24'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:47 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:47 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:47 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 1073741824" returned: 0 in 0.595s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:47 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.451s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG cinder.manager [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:47 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Deleted volume successfully. Jul 24 12:46:47 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 Jul 24 12:46:47 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-9ad33787-e52f-4cab-808d-4a45ddc1f2bc req-0a43bb42-e4cc-47c1-b4e2-45602b1cf395 tempest-VolumesSnapshotsTestJSON-1428594868 None] Lock "cinder-b3ada5e8-0737-4c64-bd4a-cc56ed7054b0-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:48 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180" returned: 0 in 0.562s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:46:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d000eb37-2f28-4506-be28-cb96aa7bb689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d633ad99-026d-4b76-a402-c919ceded180', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f07941-691b-4263-93ed-f38c7725d5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:48 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Volume volume-d633ad99-026d-4b76-a402-c919ceded180 (d633ad99-026d-4b76-a402-c919ceded180): created successfully Jul 24 12:46:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f07941-691b-4263-93ed-f38c7725d5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Flow 'volume_create_manager' (8afdfc84-1895-4a84-8afa-b44b8e8b3c5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1ac930c7-baef-4da1-a4af-9775cdd40f34 tempest-VolumesDeleteCascade-1576032237 None] Created volume successfully. Jul 24 12:46:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Creating offline snapshot 29d02a5e-a654-46e7-96dd-2b5a6733e0c2 of volume d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:46:49 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c98f161-7f93-48ba-bb06-6333a1a55db3]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:49 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 Jul 24 12:46:49 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:50 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180" returned: 0 in 0.705s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:50 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 1G Jul 24 12:46:50 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:50 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 1G" returned: 0 in 0.821s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d633ad99-026d-4b76-a402-c919ceded180 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:50 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d633ad99-026d-4b76-a402-c919ceded180 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 Jul 24 12:46:50 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "cinder-21ab9f3e-0c58-49c7-8959-38c7f235bc0b-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-21ab9f3e-0c58-49c7-8959-38c7f235bc0b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "cinder-quobyte-21ab9f3e-0c58-49c7-8959-38c7f235bc0b" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-quobyte-21ab9f3e-0c58-49c7-8959-38c7f235bc0b" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d0ac7c-0cb9-4d10-a639-a052f9c74d65]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:51 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b Jul 24 12:46:51 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:51 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d633ad99-026d-4b76-a402-c919ceded180 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2" returned: 0 in 0.545s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:51 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 is being set with open permissions: ugo+rw Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:51 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 Jul 24 12:46:51 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:51 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b" returned: 0 in 0.474s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:51 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b Jul 24 12:46:51 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:51 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2" returned: 0 in 0.422s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:52 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.info Jul 24 12:46:52 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:52 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-21ab9f3e-0c58-49c7-8959-38c7f235bc0b" returned: 0 in 0.508s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-quobyte-21ab9f3e-0c58-49c7-8959-38c7f235bc0b" released by "delete_volume" :: held 1.068s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Created reservations ['6e3dd7e5-a531-475b-8c4c-7166a89f9bc1', '73bb5a83-1a9b-471c-b167-718ffab2bfad', 'a99fd11b-5fc3-435b-ab00-cbbdb38fcd7d', 'd0621801-2efe-455a-b415-73dfa69b9fdf'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:52 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.info" returned: 0 in 0.566s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:52 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.info is being set with open permissions: ugo+rw Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:52 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.info Jul 24 12:46:52 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:52 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:52 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:52 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.info" returned: 0 in 0.369s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.709s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-46d9a0f6-4085-4e82-9939-1bf6facb7fc6 tempest-VolumesDeleteCascade-1576032237 None] Create snapshot completed successfully Jul 24 12:46:53 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.412s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Deleted volume successfully. Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1f3a13af-7dd8-4341-8d68-ece64493a0a0 tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-21ab9f3e-0c58-49c7-8959-38c7f235bc0b-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "cinder-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "cinder-quobyte-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-quobyte-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8250fd6-c68c-4e87-ba1d-84696113dd37]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:53 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 Jul 24 12:46:53 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:53 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47" returned: 0 in 0.587s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:53 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47 Jul 24 12:46:53 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-07c4b6b0-ec67-4a63-beb5-5770cccbeaa6 tempest-VolumesActionsTest-350082901 None] Acquiring lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962" by "attach_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:54 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-07c4b6b0-ec67-4a63-beb5-5770cccbeaa6 tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962" acquired by "attach_volume" :: waited 0.050s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47" returned: 0 in 0.344s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-quobyte-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47" released by "delete_volume" :: held 0.996s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-07c4b6b0-ec67-4a63-beb5-5770cccbeaa6 tempest-VolumesActionsTest-350082901 None] Attaching volume 9177d86a-ef10-4343-929a-6afb8754d962 to instance c73f384b-7dba-4962-8665-ed7ee91dede6 at mountpoint /dev/vdb on host None. Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Created reservations ['e9d66546-3d8e-44f8-bdee-2063c9067844', '9b031953-33c8-40f3-b10c-66431f290ab7', 'bd1fc980-a21f-4600-bd2e-31fce9875b8c', 'ef73aab2-dc8f-4443-a1dc-fbf28b725b1a'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-07c4b6b0-ec67-4a63-beb5-5770cccbeaa6 tempest-VolumesActionsTest-350082901 None] Attach volume completed successfully. Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-07c4b6b0-ec67-4a63-beb5-5770cccbeaa6 tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962" released by "attach_volume" :: held 0.225s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Flow 'volume_create_manager' (541e5770-5149-4a96-8efb-12379f68ad71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831b31f1-df30-4abf-b74f-2c7a07fe4f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831b31f1-df30-4abf-b74f-2c7a07fe4f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-360156976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694c587a-c31d-41c5-9a74-92d7473ec1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97db4c64f3d4b52ae3b433608d39e12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=29d02a5e-a654-46e7-96dd-2b5a6733e0c2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:54Z,use_quota=True,user_id='5c6a98eb38e844e6bc50c033c6f24987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a019833-2f59-48ae-90b9-fd6e6f2cf497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a019833-2f59-48ae-90b9-fd6e6f2cf497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe913e5-f2c8-45b4-aebf-7aaedeeeb277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe913e5-f2c8-45b4-aebf-7aaedeeeb277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '694c587a-c31d-41c5-9a74-92d7473ec1ba', 'volume_name': 'volume-694c587a-c31d-41c5-9a74-92d7473ec1ba', 'volume_size': 1, 'snapshot_id': '29d02a5e-a654-46e7-96dd-2b5a6733e0c2'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7943cded-5161-453b-a99c-3c8bbb209977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7943cded-5161-453b-a99c-3c8bbb209977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296237ae-bb24-42c9-942a-a9ef493855c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Volume 694c587a-c31d-41c5-9a74-92d7473ec1ba: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-694c587a-c31d-41c5-9a74-92d7473ec1ba', 'volume_size': 1, 'snapshot_id': '29d02a5e-a654-46e7-96dd-2b5a6733e0c2'} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-29d02a5e-a654-46e7-96dd-2b5a6733e0c2-694c587a-c31d-41c5-9a74-92d7473ec1ba" by "_create_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Flow 'volume_create_manager' (eea5aa72-70be-440e-80a5-d6f82c1c6419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd31bb4-c581-4577-baef-f8c9ee3edc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-29d02a5e-a654-46e7-96dd-2b5a6733e0c2-694c587a-c31d-41c5-9a74-92d7473ec1ba" acquired by "_create_volume_from_snapshot" :: waited 0.081s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Creating volume 694c587a-c31d-41c5-9a74-92d7473ec1ba from snapshot 29d02a5e-a654-46e7-96dd-2b5a6733e0c2 {{(pid=88540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-694c587a-c31d-41c5-9a74-92d7473ec1ba" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:54 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:54 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4497e2c0-417a-4090-b536-6ea7634de7e5 tempest-VolumesActionsTest-350082901 None] Acquiring lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962-detach_volume" by "detach_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dd31bb4-c581-4577-baef-f8c9ee3edc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1172699785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430b1dcf-d840-43f7-85d0-666bdfe8385b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a35a2c562f1d46b29a73e502de078a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:54Z,use_quota=True,user_id='d11753ef32014fffa8cb35af98e88c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00e49ac-e4be-48ff-9fed-be2095193d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00e49ac-e4be-48ff-9fed-be2095193d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4c48ff-3d85-46de-8d8a-3a22cb7ecd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b4c48ff-3d85-46de-8d8a-3a22cb7ecd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430b1dcf-d840-43f7-85d0-666bdfe8385b', 'volume_name': 'volume-430b1dcf-d840-43f7-85d0-666bdfe8385b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b33507-83fc-4bd8-877c-c69f2732894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b33507-83fc-4bd8-877c-c69f2732894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3a6ad6-2c88-4e68-a484-e233982554a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:46:54 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Volume 430b1dcf-d840-43f7-85d0-666bdfe8385b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430b1dcf-d840-43f7-85d0-666bdfe8385b', 'volume_size': 1} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-694c587a-c31d-41c5-9a74-92d7473ec1ba" acquired by "_copy_volume_from_snapshot" :: waited 0.078s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] snapshot: 29d02a5e-a654-46e7-96dd-2b5a6733e0c2, volume: 694c587a-c31d-41c5-9a74-92d7473ec1ba, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4497e2c0-417a-4090-b536-6ea7634de7e5 tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4497e2c0-417a-4090-b536-6ea7634de7e5 tempest-VolumesActionsTest-350082901 None] Detaching volume 9177d86a-ef10-4343-929a-6afb8754d962 from instance c73f384b-7dba-4962-8665-ed7ee91dede6. Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b69089-0426-4417-a830-33301753b538]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4497e2c0-417a-4090-b536-6ea7634de7e5 tempest-VolumesActionsTest-350082901 None] Detach volume completed successfully. Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4497e2c0-417a-4090-b536-6ea7634de7e5 tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962-detach_volume" released by "detach_volume" :: held 0.128s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:54 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.302s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:54 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Deleted volume successfully. Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a9e1793b-7352-49bb-919b-beb1a0e5b3b6 tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-7b4dd5a6-86e4-4df2-9aec-83ca034e7b47-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:55 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 Jul 24 12:46:55 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:55 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2" returned: 0 in 0.533s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d633ad99-026d-4b76-a402-c919ceded180(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a192354-cd7c-4288-b866-e809ebd322ba]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:55 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 Jul 24 12:46:55 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "cinder-252c1344-f792-48bd-a405-b00b9e9964e1-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-252c1344-f792-48bd-a405-b00b9e9964e1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "cinder-quobyte-252c1344-f792-48bd-a405-b00b9e9964e1" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-quobyte-252c1344-f792-48bd-a405-b00b9e9964e1" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47b0619-ab5e-45aa-840a-2cf94dc11778]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:55 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1 Jul 24 12:46:55 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:55 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180" returned: 0 in 0.498s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:46:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:55 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba Jul 24 12:46:55 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:56 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1" returned: 0 in 0.561s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:56 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1 Jul 24 12:46:56 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:56 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-252c1344-f792-48bd-a405-b00b9e9964e1" returned: 0 in 0.291s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-quobyte-252c1344-f792-48bd-a405-b00b9e9964e1" released by "delete_volume" :: held 0.896s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Created reservations ['178f5f07-37d8-4ff5-95fe-7970986342d5', '097d93ed-1098-4382-a139-b43982d3ad00', '8965c655-705f-4792-8db6-b774f4009253', '7b65b7a1-09d4-44da-8e11-4909eab1885f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:46:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:46:56 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:46:56 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:46:57 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 24 12:46:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.926s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:46:57 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:46:57 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Deleted volume successfully. Jul 24 12:46:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e8c696ac-f000-442f-a64e-5ca81fd7dc2b tempest-VolumesListTestJSON-1818790177 None] Lock "cinder-252c1344-f792-48bd-a405-b00b9e9964e1-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:01 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba" returned: 0 in 5.760s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:01 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f2fd7e-c679-4389-b004-885028d3fd65]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:01 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 Jul 24 12:47:01 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:02 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180" returned: 0 in 0.585s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180, size 1024.00 MB, duration 5.76 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:47:02 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Converted 1024.00 MB image at 177.69 MB/s Jul 24 12:47:02 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba is being set with open permissions: ugo+rw Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:02 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba Jul 24 12:47:02 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:02 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba" returned: 0 in 0.273s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-694c587a-c31d-41c5-9a74-92d7473ec1ba" released by "_copy_volume_from_snapshot" :: held 7.774s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-29d02a5e-a654-46e7-96dd-2b5a6733e0c2-694c587a-c31d-41c5-9a74-92d7473ec1ba" released by "_create_volume_from_snapshot" :: held 7.877s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.959s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.809s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1172699785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430b1dcf-d840-43f7-85d0-666bdfe8385b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a35a2c562f1d46b29a73e502de078a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:46:54Z,use_quota=True,user_id='d11753ef32014fffa8cb35af98e88c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Creating volume 430b1dcf-d840-43f7-85d0-666bdfe8385b {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:47:02 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:02 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b 1073741824 Jul 24 12:47:02 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (296237ae-bb24-42c9-942a-a9ef493855c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694c587a-c31d-41c5-9a74-92d7473ec1ba', 'volume_size': 1, 'snapshot_id': '29d02a5e-a654-46e7-96dd-2b5a6733e0c2'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82167863-538b-4029-9eaf-93e01aa6baa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:02 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Volume volume-694c587a-c31d-41c5-9a74-92d7473ec1ba (694c587a-c31d-41c5-9a74-92d7473ec1ba): created successfully Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82167863-538b-4029-9eaf-93e01aa6baa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Flow 'volume_create_manager' (541e5770-5149-4a96-8efb-12379f68ad71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:02 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a6845309-6a26-42ea-802c-68094cc5b9f5 tempest-VolumesDeleteCascade-1576032237 None] Created volume successfully. Jul 24 12:47:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:03 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b 1073741824" returned: 0 in 0.472s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:03 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b Jul 24 12:47:03 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Flow 'volume_create_manager' (7c8a3917-2fb1-4c25-8fe9-37c690cdade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e63eaa-afd7-4874-864f-96b12af0b3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7e63eaa-afd7-4874-864f-96b12af0b3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-203750441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e1d91e-77f5-43c2-bcca-5b3f0a76d724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ede3daf12b4c2e9ef8df6775103dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:03Z,use_quota=True,user_id='52e10c9ae92b47ab8bdfcafbb76372c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8021e276-773c-4318-9cdd-676296d7cf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8021e276-773c-4318-9cdd-676296d7cf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80c59de-d385-411a-ad7e-9feb8bf837bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f80c59de-d385-411a-ad7e-9feb8bf837bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e1d91e-77f5-43c2-bcca-5b3f0a76d724', 'volume_name': 'volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cea8667-d6a0-4ecd-9e10-298a45259c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cea8667-d6a0-4ecd-9e10-298a45259c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06585555-c55d-4319-92e2-4c53c9fada3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:03 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Volume 38e1d91e-77f5-43c2-bcca-5b3f0a76d724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724', 'volume_size': 1} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:03 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b" returned: 0 in 0.248s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.604s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e3a6ad6-2c88-4e68-a484-e233982554a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430b1dcf-d840-43f7-85d0-666bdfe8385b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5d45fa-ff07-4778-b7c7-183bbc128d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08aea66-3118-409b-8254-1029b49bde66]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:03 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Volume volume-430b1dcf-d840-43f7-85d0-666bdfe8385b (430b1dcf-d840-43f7-85d0-666bdfe8385b): created successfully Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5d45fa-ff07-4778-b7c7-183bbc128d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Flow 'volume_create_manager' (eea5aa72-70be-440e-80a5-d6f82c1c6419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e5e3740b-e674-4d6c-8b05-35d21dd33a4e tempest-VolumesTestJSON-183053160 None] Created volume successfully. Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-d633ad99-026d-4b76-a402-c919ceded180-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-d633ad99-026d-4b76-a402-c919ceded180-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:03 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 Jul 24 12:47:03 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Performing cascade delete. {{(pid=88540) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-29d02a5e-a654-46e7-96dd-2b5a6733e0c2-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-29d02a5e-a654-46e7-96dd-2b5a6733e0c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-d633ad99-026d-4b76-a402-c919ceded180" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-d633ad99-026d-4b76-a402-c919ceded180" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-29d02a5e-a654-46e7-96dd-2b5a6733e0c2" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-29d02a5e-a654-46e7-96dd-2b5a6733e0c2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Deleting offline snapshot 29d02a5e-a654-46e7-96dd-2b5a6733e0c2 of volume d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] snapshot_file for this snap is: volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b1428d-42f1-497b-9666-03b282db3842]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:03 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 Jul 24 12:47:03 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:03 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962" returned: 0 in 0.392s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc45489-ff7e-4490-b727-469c230c2328]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:03 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 Jul 24 12:47:03 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:04 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2" returned: 0 in 0.428s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d633ad99-026d-4b76-a402-c919ceded180(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b7ecb9-ce32-4068-8f41-06be79d09047]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Flow 'volume_create_manager' (f5716000-215e-4a3c-a3e1-10a3db13f02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b98b2-970a-4725-a6b1-0d63f84e1ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8b98b2-970a-4725-a6b1-0d63f84e1ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-637937193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cac51df-6794-4bcd-bcfd-5439a2aa9275,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a35a2c562f1d46b29a73e502de078a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:04Z,use_quota=True,user_id='d11753ef32014fffa8cb35af98e88c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ceb8e-9a8b-4f45-a725-71243af59d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:04 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ceb8e-9a8b-4f45-a725-71243af59d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7b4412-cb95-449c-9ba0-80275b0b02fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b7b4412-cb95-449c-9ba0-80275b0b02fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cac51df-6794-4bcd-bcfd-5439a2aa9275', 'volume_name': 'volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:04 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 Jul 24 12:47:04 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd3965e-d015-4e02-b9e0-e3dc6e07b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fd3965e-d015-4e02-b9e0-e3dc6e07b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267d883f-6511-4d55-91cb-1ddb848ce3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:04 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Volume 4cac51df-6794-4bcd-bcfd-5439a2aa9275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275', 'volume_size': 1} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962" returned: 0 in 0.448s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.efa24487-ee51-46c3-8efa-47934be8924d4wl_om49.img {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:04 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.efa24487-ee51-46c3-8efa-47934be8924d4wl_om49.img Jul 24 12:47:04 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:04 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180" returned: 0 in 0.369s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:04 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 Jul 24 12:47:04 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:05 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2" returned: 0 in 0.832s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:05 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2 Jul 24 12:47:05 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:05 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180.29d02a5e-a654-46e7-96dd-2b5a6733e0c2" returned: 0 in 0.509s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-29d02a5e-a654-46e7-96dd-2b5a6733e0c2" released by "_delete_snapshot" :: held 2.292s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-d633ad99-026d-4b76-a402-c919ceded180" released by "delete_snapshot" :: held 2.324s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:06 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Created reservations ['3200a5d6-fbee-4978-9cbe-88a5358b4a6d', '347e8778-3096-4237-8aed-0c169076da21', '4e426e54-1358-4c8b-b1d6-cd7e7fcfaacf', 'fddfa8db-0993-49c0-8a33-8731d0f53d5e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Delete snapshot completed successfully. Jul 24 12:47:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-29d02a5e-a654-46e7-96dd-2b5a6733e0c2-delete_snapshot" released by "delete_snapshot" :: held 2.715s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Snapshots deleted, issuing volume delete {{(pid=88540) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 24 12:47:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-d633ad99-026d-4b76-a402-c919ceded180" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-d633ad99-026d-4b76-a402-c919ceded180" acquired by "delete_volume" :: waited 0.067s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:06 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[301600f5-e2e0-4443-a11a-16221f57ff18]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:06 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 Jul 24 12:47:06 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:07 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180" returned: 0 in 0.718s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:07 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180 Jul 24 12:47:07 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:07 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d633ad99-026d-4b76-a402-c919ceded180" returned: 0 in 0.455s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-d633ad99-026d-4b76-a402-c919ceded180" released by "delete_volume" :: held 1.335s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Created reservations ['874ece11-3c58-4a4d-88f2-1a236e2cc04b', 'ab7e351d-e62f-4094-92f9-5bd6ffa9b501', '8efa6f21-e05d-4820-8c49-ed5858dbf88f', '7dc36782-145d-471f-b38f-ee06a3f34fbd'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:08 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:08 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:08 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.577s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Deleted volume successfully. Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-694c587a-c31d-41c5-9a74-92d7473ec1ba-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3739590-3b7a-49e4-9736-f94c0ce48371 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-d633ad99-026d-4b76-a402-c919ceded180-delete_volume" released by "delete_volume" :: held 5.135s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-694c587a-c31d-41c5-9a74-92d7473ec1ba-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "cinder-quobyte-694c587a-c31d-41c5-9a74-92d7473ec1ba" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-694c587a-c31d-41c5-9a74-92d7473ec1ba" acquired by "delete_volume" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a0da0b-60f9-4c26-948d-e7b8a487738d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:08 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.efa24487-ee51-46c3-8efa-47934be8924d4wl_om49.img" returned: 0 in 4.665s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a089b2-651b-4db1-ad9d-b6fbbcebe743]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:08 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba Jul 24 12:47:08 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:09 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 Jul 24 12:47:09 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:09 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba" returned: 0 in 0.356s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:09 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba Jul 24 12:47:09 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:09 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:09 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-694c587a-c31d-41c5-9a74-92d7473ec1ba" returned: 0 in 0.246s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962" returned: 0 in 0.543s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962, size 1024.00 MB, duration 4.67 sec, destination /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.efa24487-ee51-46c3-8efa-47934be8924d4wl_om49.img {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:47:09 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Converted 1024.00 MB image at 219.43 MB/s Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-quobyte-694c587a-c31d-41c5-9a74-92d7473ec1ba" released by "delete_volume" :: held 0.706s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] efa24487-ee51-46c3-8efa-47934be8924d was raw, no need to convert to raw {{(pid=88540) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Created reservations ['fce206c5-479c-424c-9378-ecbece479db4', 'b674766f-ebaf-4a08-b774-e6f46f4ba421', 'c48fafff-3a82-4023-b803-56826a814cd7', '7cd160f8-0583-447f-880e-54976df23792'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:09 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:09 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:09 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.272s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:09 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Deleted volume successfully. Jul 24 12:47:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5aee296a-2337-4b22-ab10-a678e37ca9e4 tempest-VolumesDeleteCascade-1576032237 None] Lock "cinder-694c587a-c31d-41c5-9a74-92d7473ec1ba-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=153,cinder:INSERT=41,cinder:UPDATE=172,cinder:DELETE=15 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=178,cinder:DELETE=14,cinder:SELECT=136,cinder:INSERT=47 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Flow 'volume_create_manager' (6ac8b931-d59d-4f5b-9555-0271ae85c397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a3ab7b-bfff-4e74-8e8b-b9cfb60dd1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a3ab7b-bfff-4e74-8e8b-b9cfb60dd1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1099430753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a385d551-f8bb-4792-bfde-56e7449bafbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0583288d1f2648a2b917e14b423f2321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:14Z,use_quota=True,user_id='73e3bc868fa04663b4127c16a03acd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75eb8d5a-b484-467e-956f-a5c03b41814c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75eb8d5a-b484-467e-956f-a5c03b41814c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7fc29c-9974-4b89-9a58-d08dfdccf339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7fc29c-9974-4b89-9a58-d08dfdccf339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a385d551-f8bb-4792-bfde-56e7449bafbd', 'volume_name': 'volume-a385d551-f8bb-4792-bfde-56e7449bafbd', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bda56a-e33d-4682-a261-bc0c8babd83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7bda56a-e33d-4682-a261-bc0c8babd83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab133df-f1bd-431e-aeb9-09c7f416d186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:14 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Volume a385d551-f8bb-4792-bfde-56e7449bafbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a385d551-f8bb-4792-bfde-56e7449bafbd', 'volume_size': 1} Jul 24 12:47:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:24 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.617s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Uploaded volume to glance image-id: efa24487-ee51-46c3-8efa-47934be8924d. {{(pid=88540) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.756s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-203750441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e1d91e-77f5-43c2-bcca-5b3f0a76d724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7ede3daf12b4c2e9ef8df6775103dea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:03Z,use_quota=True,user_id='52e10c9ae92b47ab8bdfcafbb76372c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Creating volume 38e1d91e-77f5-43c2-bcca-5b3f0a76d724 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:47:28 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:47:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:28 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 1073741824 Jul 24 12:47:28 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cbc0872b-b2ff-4337-907e-09e2856b20d4 tempest-VolumesActionsTest-350082901 None] Copy volume to image completed successfully. Jul 24 12:47:29 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 1073741824" returned: 0 in 0.403s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:29 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 Jul 24 12:47:29 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:29 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724" returned: 0 in 0.235s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.415s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-637937193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cac51df-6794-4bcd-bcfd-5439a2aa9275,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a35a2c562f1d46b29a73e502de078a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:04Z,use_quota=True,user_id='d11753ef32014fffa8cb35af98e88c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Creating volume 4cac51df-6794-4bcd-bcfd-5439a2aa9275 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:47:29 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:29 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 1073741824 Jul 24 12:47:29 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06585555-c55d-4319-92e2-4c53c9fada3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3170cb8a-f93c-4162-ba62-7cb1f39268ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:29 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Volume volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 (38e1d91e-77f5-43c2-bcca-5b3f0a76d724): created successfully Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3170cb8a-f93c-4162-ba62-7cb1f39268ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Flow 'volume_create_manager' (7c8a3917-2fb1-4c25-8fe9-37c690cdade1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a51bbc90-fa5e-430c-ba48-f71371339543 tempest-VolumesNegativeTest-1658581542 None] Created volume successfully. Jul 24 12:47:30 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 1073741824" returned: 0 in 0.454s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:30 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 Jul 24 12:47:30 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:30 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275" returned: 0 in 0.292s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.808s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1099430753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a385d551-f8bb-4792-bfde-56e7449bafbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0583288d1f2648a2b917e14b423f2321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:14Z,use_quota=True,user_id='73e3bc868fa04663b4127c16a03acd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Creating volume a385d551-f8bb-4792-bfde-56e7449bafbd {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:47:30 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267d883f-6511-4d55-91cb-1ddb848ce3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:30 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd 1073741824 Jul 24 12:47:30 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e96a0ab-f898-4d53-a914-fa6a05ac4179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:30 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Volume volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 (4cac51df-6794-4bcd-bcfd-5439a2aa9275): created successfully Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e96a0ab-f898-4d53-a914-fa6a05ac4179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Flow 'volume_create_manager' (f5716000-215e-4a3c-a3e1-10a3db13f02a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5ff59466-64f7-4c74-b198-3401c014bf8c tempest-VolumesTestJSON-183053160 None] Created volume successfully. Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:30 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd 1073741824" returned: 0 in 0.495s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:31 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd Jul 24 12:47:31 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:31 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd" returned: 0 in 0.266s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.602s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab133df-f1bd-431e-aeb9-09c7f416d186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a385d551-f8bb-4792-bfde-56e7449bafbd', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0aaa50-11cc-406c-b93f-b9c52384f64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed55a69-0040-461e-b3f1-a40a1e147806]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:31 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Volume volume-a385d551-f8bb-4792-bfde-56e7449bafbd (a385d551-f8bb-4792-bfde-56e7449bafbd): created successfully Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e0aaa50-11cc-406c-b93f-b9c52384f64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Flow 'volume_create_manager' (6ac8b931-d59d-4f5b-9555-0271ae85c397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:31 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-81b271c6-db24-4335-a53f-da60a7427766 tempest-VolumesTransfersTest-2046010676 None] Created volume successfully. Jul 24 12:47:31 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 Jul 24 12:47:31 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:31 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962" returned: 0 in 0.554s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4ee846-51fb-43f6-b368-72fab0b9820c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:31 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:47:31 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 Jul 24 12:47:31 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Flow 'volume_create_manager' (68c6362b-658a-447d-8547-86d1ef7ded7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a97bbbb-c398-41b2-a629-730d8258d9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a97bbbb-c398-41b2-a629-730d8258d9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1069144037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0904873e-ba16-460f-ad0e-f9d173081194,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a35a2c562f1d46b29a73e502de078a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:32Z,use_quota=True,user_id='d11753ef32014fffa8cb35af98e88c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e93d5a8-4d67-4b23-8b05-8cb66f5a159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e93d5a8-4d67-4b23-8b05-8cb66f5a159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d400bb0c-b442-4a7e-a812-4d16d57f431c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d400bb0c-b442-4a7e-a812-4d16d57f431c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0904873e-ba16-460f-ad0e-f9d173081194', 'volume_name': 'volume-0904873e-ba16-460f-ad0e-f9d173081194', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9b6c7d-3826-429d-a34d-f5e0300bded0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9b6c7d-3826-429d-a34d-f5e0300bded0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea66f48f-d761-4efb-a927-bfe49efd1fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:32 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Volume 0904873e-ba16-460f-ad0e-f9d173081194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0904873e-ba16-460f-ad0e-f9d173081194', 'volume_size': 1} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:32 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962" returned: 0 in 0.434s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:32 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img Jul 24 12:47:32 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3e985746-1c5e-41e8-891a-b9e42a4581ee tempest-VolumesTransfersTest-1455711954 None] Transfer volume completed successfully. Jul 24 12:47:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Acquiring lock "cinder-a385d551-f8bb-4792-bfde-56e7449bafbd-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Lock "cinder-a385d551-f8bb-4792-bfde-56e7449bafbd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Acquiring lock "cinder-quobyte-a385d551-f8bb-4792-bfde-56e7449bafbd" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Lock "cinder-quobyte-a385d551-f8bb-4792-bfde-56e7449bafbd" acquired by "delete_volume" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:34 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2904aa-030c-4d25-821f-5459913e3c37]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:34 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd Jul 24 12:47:34 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:34 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd" returned: 0 in 0.573s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:34 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd Jul 24 12:47:34 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:35 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a385d551-f8bb-4792-bfde-56e7449bafbd" returned: 0 in 0.473s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Lock "cinder-quobyte-a385d551-f8bb-4792-bfde-56e7449bafbd" released by "delete_volume" :: held 1.155s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:35 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Created reservations ['a6ab2b98-e4d4-4ac1-9b00-696b2b616ca4', '4e2e1592-2d89-4461-aeb5-7ec3185b2583', '68513154-0917-482d-8a98-f54f83d6886d', '614876ff-8a79-45f0-925b-dd7afe44b60a'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:35 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:35 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:35 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.424s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:36 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Deleted volume successfully. Jul 24 12:47:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0bfb881b-3560-44b2-83d8-8ac6cf84288f tempest-VolumesTransfersTest-1522173695 None] Lock "cinder-a385d551-f8bb-4792-bfde-56e7449bafbd-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:37 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:47:38 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Flow 'volume_create_manager' (7dc62569-1a10-418f-8c26-8621cb4fe46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c9f042-9a21-4e03-bbc4-fcd40c9112da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img" returned: 0 in 5.738s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c9f042-9a21-4e03-bbc4-fcd40c9112da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-189491422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897bdf9f-540c-451a-8f37-804ac509f6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0583288d1f2648a2b917e14b423f2321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:38Z,use_quota=True,user_id='73e3bc868fa04663b4127c16a03acd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65fa37d-7fd6-449d-8f9d-13c25a9722db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65fa37d-7fd6-449d-8f9d-13c25a9722db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2c0471-beb0-47d4-98d3-36bedf9bb63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2c0471-beb0-47d4-98d3-36bedf9bb63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897bdf9f-540c-451a-8f37-804ac509f6ed', 'volume_name': 'volume-897bdf9f-540c-451a-8f37-804ac509f6ed', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5ee08a-07a7-4dcf-9df6-5f89822ac947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d5ee08a-07a7-4dcf-9df6-5f89822ac947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3d6f1a-c3bc-403a-91ec-8caa5d7c8e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:38 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Volume 897bdf9f-540c-451a-8f37-804ac509f6ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897bdf9f-540c-451a-8f37-804ac509f6ed', 'volume_size': 1} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee23981-5f13-432c-bcba-b512391f5f3d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:38 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 Jul 24 12:47:38 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:38 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962" returned: 0 in 0.678s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962, size 1024.00 MB, duration 5.74 sec, destination /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:47:38 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Converted 1024.00 MB image at 178.43 MB/s Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] 2d745471-9ed3-40c6-8905-56f637c6ab5d was raw, converting to qcow2 {{(pid=88540) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a73a1e-c505-40e5-af3a-aaf088a27b8e]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:39 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img Jul 24 12:47:39 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:39 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img" returned: 0 in 0.462s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:39 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img Jul 24 12:47:39 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:39 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img" returned: 1 in 0.468s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:47:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img /opt/stack/data/cinder/conversion/vol_upload_4b7j2fwg {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:39 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img /opt/stack/data/cinder/conversion/vol_upload_4b7j2fwg Jul 24 12:47:39 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:40 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img /opt/stack/data/cinder/conversion/vol_upload_4b7j2fwg" returned: 0 in 0.262s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:40 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Image conversion details: src /opt/stack/data/cinder/conversion/9177d86a-ef10-4343-929a-6afb8754d962.temp_image.2d745471-9ed3-40c6-8905-56f637c6ab5dugw_y9ml.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4b7j2fwg {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:47:40 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 24 12:47:40 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[de67b332-ca6e-46ac-9375-a94a868d5877]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4b7j2fwg {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:40 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4b7j2fwg Jul 24 12:47:40 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:40 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4b7j2fwg" returned: 0 in 0.351s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.675s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Uploaded volume to glance image-id: 2d745471-9ed3-40c6-8905-56f637c6ab5d. {{(pid=88540) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.806s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1069144037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0904873e-ba16-460f-ad0e-f9d173081194,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a35a2c562f1d46b29a73e502de078a4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:32Z,use_quota=True,user_id='d11753ef32014fffa8cb35af98e88c75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Creating volume 0904873e-ba16-460f-ad0e-f9d173081194 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:47:41 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:47:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:41 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194 1073741824 Jul 24 12:47:41 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:42 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d8389773-0478-4598-a318-2fcc852b517e tempest-VolumesActionsTest-350082901 None] Copy volume to image completed successfully. Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:42 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:42 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:42 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.308s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:47:42 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194 1073741824" returned: 0 in 0.709s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:42 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194 Jul 24 12:47:42 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:43 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194" returned: 0 in 0.305s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.935s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-189491422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897bdf9f-540c-451a-8f37-804ac509f6ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0583288d1f2648a2b917e14b423f2321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:38Z,use_quota=True,user_id='73e3bc868fa04663b4127c16a03acd8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Creating volume 897bdf9f-540c-451a-8f37-804ac509f6ed {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:47:43 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea66f48f-d761-4efb-a927-bfe49efd1fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0904873e-ba16-460f-ad0e-f9d173081194', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:43 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed 1073741824 Jul 24 12:47:43 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef6730-b4df-4a09-ab9d-2c6cf4eca2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:43 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Volume volume-0904873e-ba16-460f-ad0e-f9d173081194 (0904873e-ba16-460f-ad0e-f9d173081194): created successfully Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56ef6730-b4df-4a09-ab9d-2c6cf4eca2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Flow 'volume_create_manager' (68c6362b-658a-447d-8547-86d1ef7ded7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:43 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5060b2fb-9aa0-4869-a589-bba9ae7e6105 tempest-VolumesTestJSON-183053160 None] Created volume successfully. Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Acquiring lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Acquiring lock "cinder-quobyte-9177d86a-ef10-4343-929a-6afb8754d962" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Lock "cinder-quobyte-9177d86a-ef10-4343-929a-6afb8754d962" acquired by "delete_volume" :: waited 0.053s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[71327be8-e9a9-4307-aaa6-1aedd0bc09a8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:43 devstack sudo[99576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 Jul 24 12:47:43 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:43 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed 1073741824" returned: 0 in 0.686s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:43 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed Jul 24 12:47:43 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:43 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962" returned: 0 in 0.409s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:43 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962 Jul 24 12:47:43 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:44 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed" returned: 0 in 0.270s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d3d6f1a-c3bc-403a-91ec-8caa5d7c8e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897bdf9f-540c-451a-8f37-804ac509f6ed', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef9675f-5ee4-4407-9f70-7a3b7a78b9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:44 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Volume volume-897bdf9f-540c-451a-8f37-804ac509f6ed (897bdf9f-540c-451a-8f37-804ac509f6ed): created successfully Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef9675f-5ee4-4407-9f70-7a3b7a78b9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Flow 'volume_create_manager' (7dc62569-1a10-418f-8c26-8621cb4fe46f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c1e32d93-5d88-4458-bcd0-5f32ce0cdb4a tempest-VolumesTransfersTest-2046010676 None] Created volume successfully. Jul 24 12:47:44 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9177d86a-ef10-4343-929a-6afb8754d962" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Lock "cinder-quobyte-9177d86a-ef10-4343-929a-6afb8754d962" released by "delete_volume" :: held 0.728s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Created reservations ['e7d246d4-9e4a-4519-9f69-bd22407b1548', 'cb65665b-4230-46de-93f2-e6deda486043', '076c2bdb-2533-4fc7-a638-50aad6c48776', '10ef1009-f604-4d03-80a4-61fe13c387bb'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:44 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:44 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:44 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.357s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Acquiring lock "cinder-897bdf9f-540c-451a-8f37-804ac509f6ed-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Deleted volume successfully. Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Lock "cinder-897bdf9f-540c-451a-8f37-804ac509f6ed-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-980b035c-f641-44d6-8925-c6c4ffc89acf tempest-VolumesActionsTest-350082901 None] Lock "cinder-9177d86a-ef10-4343-929a-6afb8754d962-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Acquiring lock "cinder-quobyte-897bdf9f-540c-451a-8f37-804ac509f6ed" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Lock "cinder-quobyte-897bdf9f-540c-451a-8f37-804ac509f6ed" acquired by "delete_volume" :: waited 0.037s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9ec968-4f15-4d19-ae48-a979bf0d837d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:45 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed Jul 24 12:47:45 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:45 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed" returned: 0 in 0.410s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:45 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed Jul 24 12:47:45 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:45 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-897bdf9f-540c-451a-8f37-804ac509f6ed" returned: 0 in 0.392s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Lock "cinder-quobyte-897bdf9f-540c-451a-8f37-804ac509f6ed" released by "delete_volume" :: held 0.866s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Created reservations ['d705b707-1913-43a2-b72b-8ca1537675fb', 'f94f7098-d055-4310-ba6f-7236501b76e8', '6c0468e4-8424-4822-90c5-5ef8eee9fcff', 'c002328f-417c-4b8b-91db-50987731ebf9'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Acquiring lock "cinder-0904873e-ba16-460f-ad0e-f9d173081194-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Lock "cinder-0904873e-ba16-460f-ad0e-f9d173081194-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:45 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:46 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:46 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Acquiring lock "cinder-quobyte-0904873e-ba16-460f-ad0e-f9d173081194" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Lock "cinder-quobyte-0904873e-ba16-460f-ad0e-f9d173081194" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d84ea-c95a-43bb-aae4-4857a17d05cc]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:46 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.359s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:46 devstack sudo[99601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194 Jul 24 12:47:46 devstack sudo[99601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:46 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Deleted volume successfully. Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0825792c-cec8-4049-b2e5-b0aca7490f1d tempest-VolumesTransfersTest-1522173695 None] Lock "cinder-897bdf9f-540c-451a-8f37-804ac509f6ed-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:46 devstack sudo[99601]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194" returned: 0 in 0.614s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:46 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194 Jul 24 12:47:46 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:47 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0904873e-ba16-460f-ad0e-f9d173081194" returned: 0 in 0.318s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Lock "cinder-quobyte-0904873e-ba16-460f-ad0e-f9d173081194" released by "delete_volume" :: held 1.005s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Created reservations ['ce93e79d-a733-440c-90b6-3a30445c4809', 'b94e19bd-09e3-4d1f-9bdb-b3b2b76e1770', 'c6b15e45-95c4-4f51-8a80-618afc57bd8a', '55d37c79-3302-44bc-8c71-947b3e8c2108'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:47 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:47 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:47 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.336s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:47 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Deleted volume successfully. Jul 24 12:47:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-43ab4d06-ca60-4ae8-af82-0a41b224693b tempest-VolumesTestJSON-183053160 None] Lock "cinder-0904873e-ba16-460f-ad0e-f9d173081194-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Acquiring lock "cinder-4cac51df-6794-4bcd-bcfd-5439a2aa9275-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Lock "cinder-4cac51df-6794-4bcd-bcfd-5439a2aa9275-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Acquiring lock "cinder-quobyte-4cac51df-6794-4bcd-bcfd-5439a2aa9275" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Lock "cinder-quobyte-4cac51df-6794-4bcd-bcfd-5439a2aa9275" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:48 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78b0c78-ce42-4730-87dc-0c1d10ad5e68]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:48 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 Jul 24 12:47:48 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:49 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275" returned: 0 in 0.651s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:49 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275 Jul 24 12:47:49 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:49 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4cac51df-6794-4bcd-bcfd-5439a2aa9275" returned: 0 in 0.376s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Lock "cinder-quobyte-4cac51df-6794-4bcd-bcfd-5439a2aa9275" released by "delete_volume" :: held 1.119s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Created reservations ['34196009-8452-4035-ab35-875be8e14a8e', '1897e89f-2b85-4353-9f2b-452e429887e2', '72557cdd-378f-4b99-9faa-3d1e00abb177', '97520631-8601-40db-8394-9f44c0c6978f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:49 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:49 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:50 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.382s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:50 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:50 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Deleted volume successfully. Jul 24 12:47:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5e837bd6-a862-4ce3-ab29-5c83306cefa1 tempest-VolumesTestJSON-183053160 None] Lock "cinder-4cac51df-6794-4bcd-bcfd-5439a2aa9275-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Acquiring lock "cinder-430b1dcf-d840-43f7-85d0-666bdfe8385b-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Lock "cinder-430b1dcf-d840-43f7-85d0-666bdfe8385b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Acquiring lock "cinder-quobyte-430b1dcf-d840-43f7-85d0-666bdfe8385b" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Lock "cinder-quobyte-430b1dcf-d840-43f7-85d0-666bdfe8385b" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:50 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58975d3-9833-4e6d-95d9-aa73e6f40798]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:51 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b Jul 24 12:47:51 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:51 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b" returned: 0 in 0.530s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:51 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b Jul 24 12:47:51 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:51 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-430b1dcf-d840-43f7-85d0-666bdfe8385b" returned: 0 in 0.274s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Lock "cinder-quobyte-430b1dcf-d840-43f7-85d0-666bdfe8385b" released by "delete_volume" :: held 0.874s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Created reservations ['acd79551-0a4e-48e8-ad5c-431381089ffa', 'af7d99ab-9a8a-44dc-84f6-946f5f502a2b', '72f08362-7f59-4997-b424-e764054e0573', 'ccb3a79e-527d-45fc-8d69-34c324fc268d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:51 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:51 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:52 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.305s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:52 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:52 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Deleted volume successfully. Jul 24 12:47:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f907e001-3925-4fff-806f-801b16bd8ee1 tempest-VolumesTestJSON-183053160 None] Lock "cinder-430b1dcf-d840-43f7-85d0-666bdfe8385b-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Acquiring lock "cinder-38e1d91e-77f5-43c2-bcca-5b3f0a76d724-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Lock "cinder-38e1d91e-77f5-43c2-bcca-5b3f0a76d724-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Acquiring lock "cinder-quobyte-38e1d91e-77f5-43c2-bcca-5b3f0a76d724" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Lock "cinder-quobyte-38e1d91e-77f5-43c2-bcca-5b3f0a76d724" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:53 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef60373f-bb88-4cc5-9e7b-83e063c23b03]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:53 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 Jul 24 12:47:53 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:54 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724" returned: 0 in 0.467s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:54 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724 Jul 24 12:47:54 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:54 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38e1d91e-77f5-43c2-bcca-5b3f0a76d724" returned: 0 in 0.348s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Lock "cinder-quobyte-38e1d91e-77f5-43c2-bcca-5b3f0a76d724" released by "delete_volume" :: held 0.898s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Created reservations ['8a7f7f43-86dd-4789-8add-2c9272d18645', '0f6cd0cb-996c-425f-8acf-e959ced19fac', 'e2638824-c649-4fd1-89f9-2a83750db897', '09ae995e-0899-438b-acb4-bfa90d17172f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Flow 'volume_create_manager' (189c6663-abde-40a3-af90-189ab6574f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d265aa1-dd76-4cd7-a50c-e4c366565922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d265aa1-dd76-4cd7-a50c-e4c366565922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-758338663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd990f6-3def-4689-a1c4-ad4586863b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e598cdbdb4b42d1a2f06fb1d3027f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:54Z,use_quota=True,user_id='1aa2f75910034cddb4588bf02f6be322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fd9b81-3c1d-43a5-87a4-9d7f55de0ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20fd9b81-3c1d-43a5-87a4-9d7f55de0ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d5a0ca-a764-4694-99b4-02f32b89e739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d5a0ca-a764-4694-99b4-02f32b89e739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd990f6-3def-4689-a1c4-ad4586863b0f', 'volume_name': 'volume-6bd990f6-3def-4689-a1c4-ad4586863b0f', 'volume_size': 2}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1832966f-b61b-4a20-bad7-bd8548d3a7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1832966f-b61b-4a20-bad7-bd8548d3a7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51820b5b-4c80-403f-9801-07bf81702d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:54 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Volume 6bd990f6-3def-4689-a1c4-ad4586863b0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd990f6-3def-4689-a1c4-ad4586863b0f', 'volume_size': 2} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-758338663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd990f6-3def-4689-a1c4-ad4586863b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e598cdbdb4b42d1a2f06fb1d3027f7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:47:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:47:54Z,use_quota=True,user_id='1aa2f75910034cddb4588bf02f6be322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Creating volume 6bd990f6-3def-4689-a1c4-ad4586863b0f {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:47:54 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f 2147483648 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:54 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f 2147483648 Jul 24 12:47:54 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:54 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:54 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:55 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.309s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:55 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Deleted volume successfully. Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-364d1b94-ad25-43ca-97b9-0b7afa64aed2 tempest-VolumesNegativeTest-1658581542 None] Lock "cinder-38e1d91e-77f5-43c2-bcca-5b3f0a76d724-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:55 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f 2147483648" returned: 0 in 0.611s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:55 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f Jul 24 12:47:55 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:55 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f" returned: 0 in 0.266s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51820b5b-4c80-403f-9801-07bf81702d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd990f6-3def-4689-a1c4-ad4586863b0f', 'volume_size': 2}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34e52d5-2f14-4396-99e9-c6ac681da2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:47:55 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Volume volume-6bd990f6-3def-4689-a1c4-ad4586863b0f (6bd990f6-3def-4689-a1c4-ad4586863b0f): created successfully Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e34e52d5-2f14-4396-99e9-c6ac681da2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:47:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Flow 'volume_create_manager' (189c6663-abde-40a3-af90-189ab6574f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:47:55 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4535ac14-0ce3-45e7-9a72-512dc3d97ad2 tempest-VolumesCloneNegativeTest-1361001494 None] Created volume successfully. Jul 24 12:47:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Acquiring lock "cinder-6bd990f6-3def-4689-a1c4-ad4586863b0f-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Lock "cinder-6bd990f6-3def-4689-a1c4-ad4586863b0f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Acquiring lock "cinder-quobyte-6bd990f6-3def-4689-a1c4-ad4586863b0f" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:47:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Lock "cinder-quobyte-6bd990f6-3def-4689-a1c4-ad4586863b0f" acquired by "delete_volume" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:47:56 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8931638a-2c73-4e03-a514-75f6b6c490c2]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:47:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:57 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f Jul 24 12:47:57 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:57 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f" returned: 0 in 0.544s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:57 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f Jul 24 12:47:57 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:57 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6bd990f6-3def-4689-a1c4-ad4586863b0f" returned: 0 in 0.295s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Lock "cinder-quobyte-6bd990f6-3def-4689-a1c4-ad4586863b0f" released by "delete_volume" :: held 0.908s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Created reservations ['0fc66a30-1954-4f2a-bd67-7af972885087', 'd981955c-cb60-449e-abe0-7b165772bf07', '59e66cdd-4077-4cc5-ac2b-a65706498af6', '397ab9ac-1401-4e5f-beb1-7dcd73ec119a'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:47:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:47:58 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:47:58 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:47:58 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 24 12:47:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.335s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:47:58 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:47:58 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Deleted volume successfully. Jul 24 12:47:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d188e07-2e9c-4444-9814-54a4fd99e53b tempest-VolumesCloneNegativeTest-1361001494 None] Lock "cinder-6bd990f6-3def-4689-a1c4-ad4586863b0f-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:07 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=51,cinder:UPDATE=81,cinder:INSERT=23,cinder:DELETE=8 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:48:08 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=54,cinder:UPDATE=83,cinder:INSERT=15,cinder:DELETE=6 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (b25e33b9-9ead-4311-b518-46d812930bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1675c715-b944-40d7-9b91-b8c04cd4be32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1675c715-b944-40d7-9b91-b8c04cd4be32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-230580091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44b4434-cd5a-4892-b734-3632f980ec88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95ac7fae97946389a85cfa97c873a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:14Z,use_quota=True,user_id='bcc4bab54965415098901cfb289c3c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b097d60c-9621-4878-947e-9028dd3ab726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b097d60c-9621-4878-947e-9028dd3ab726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b40e36d-1316-47b0-9be4-191073154ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b40e36d-1316-47b0-9be4-191073154ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44b4434-cd5a-4892-b734-3632f980ec88', 'volume_name': 'volume-b44b4434-cd5a-4892-b734-3632f980ec88', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07876bd-221d-4087-a4f4-5b577368fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07876bd-221d-4087-a4f4-5b577368fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b56063-e3e0-4076-82d5-739049783de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:13 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Volume b44b4434-cd5a-4892-b734-3632f980ec88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44b4434-cd5a-4892-b734-3632f980ec88', 'volume_size': 1} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-230580091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44b4434-cd5a-4892-b734-3632f980ec88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95ac7fae97946389a85cfa97c873a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:14Z,use_quota=True,user_id='bcc4bab54965415098901cfb289c3c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Creating volume b44b4434-cd5a-4892-b734-3632f980ec88 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:48:13 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:48:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:13 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 1073741824 Jul 24 12:48:13 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:14 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 1073741824" returned: 0 in 0.563s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:14 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 Jul 24 12:48:14 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:14 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88" returned: 0 in 0.324s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:48:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b56063-e3e0-4076-82d5-739049783de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44b4434-cd5a-4892-b734-3632f980ec88', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cef87d-2ff0-4c50-913a-27c39855e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:14 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Volume volume-b44b4434-cd5a-4892-b734-3632f980ec88 (b44b4434-cd5a-4892-b734-3632f980ec88): created successfully Jul 24 12:48:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81cef87d-2ff0-4c50-913a-27c39855e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (b25e33b9-9ead-4311-b518-46d812930bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3456177c-4519-43a8-a7b1-34aa793e4181 tempest-VolumesSnapshotTestJSON-824965014 None] Created volume successfully. Jul 24 12:48:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Creating offline snapshot ddc291a8-deb8-4f79-aeb8-9afa50fad872 of volume b44b4434-cd5a-4892-b734-3632f980ec88 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:48:16 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[11df6478-e3fb-4fe4-9af4-47bb0a4a0aef]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:16 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 Jul 24 12:48:16 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:16 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88" returned: 0 in 0.407s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:16 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 1G Jul 24 12:48:16 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:17 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 1G" returned: 0 in 0.572s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44b4434-cd5a-4892-b734-3632f980ec88 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:17 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44b4434-cd5a-4892-b734-3632f980ec88 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 Jul 24 12:48:17 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:17 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44b4434-cd5a-4892-b734-3632f980ec88 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872" returned: 0 in 0.332s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:17 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 is being set with open permissions: ugo+rw Jul 24 12:48:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:17 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 Jul 24 12:48:17 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:17 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872" returned: 0 in 0.312s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:17 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.info Jul 24 12:48:17 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:18 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.info" returned: 0 in 0.419s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:18 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.info is being set with open permissions: ugo+rw Jul 24 12:48:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:18 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.info Jul 24 12:48:18 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:18 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.info" returned: 0 in 0.350s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5f1fca7d-6e7a-4dbe-911a-db8f107d0f0b tempest-VolumesSnapshotTestJSON-824965014 None] Create snapshot completed successfully Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-ddc291a8-deb8-4f79-aeb8-9afa50fad872-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-ddc291a8-deb8-4f79-aeb8-9afa50fad872-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-b44b4434-cd5a-4892-b734-3632f980ec88" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-b44b4434-cd5a-4892-b734-3632f980ec88" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-ddc291a8-deb8-4f79-aeb8-9afa50fad872" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-ddc291a8-deb8-4f79-aeb8-9afa50fad872" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Deleting offline snapshot ddc291a8-deb8-4f79-aeb8-9afa50fad872 of volume b44b4434-cd5a-4892-b734-3632f980ec88 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] snapshot_file for this snap is: volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e0eb85-e373-4af2-872b-dd38c707851a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:19 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 Jul 24 12:48:19 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:19 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872" returned: 0 in 0.437s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44b4434-cd5a-4892-b734-3632f980ec88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:48:20 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5652f75-b058-4331-a549-05e22cbe8251]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:20 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 Jul 24 12:48:20 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:20 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88" returned: 0 in 0.443s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:20 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 Jul 24 12:48:20 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:20 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872" returned: 0 in 0.360s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:20 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872 Jul 24 12:48:20 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:21 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88.ddc291a8-deb8-4f79-aeb8-9afa50fad872" returned: 0 in 0.292s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-ddc291a8-deb8-4f79-aeb8-9afa50fad872" released by "_delete_snapshot" :: held 1.682s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-b44b4434-cd5a-4892-b734-3632f980ec88" released by "delete_snapshot" :: held 1.709s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:21 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Created reservations ['29373ab1-4f51-4ef2-b5e0-02dd35c8b0d9', '1edae56a-2413-4b9f-8da7-9b8c07ad7459', 'f357adf1-7fca-4d89-98eb-292021a084b8', 'f1558b6e-1be9-46f9-9d63-689b2042adf7'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:48:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Delete snapshot completed successfully. Jul 24 12:48:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58dd6f47-a03d-4897-b261-07ce39606ec2 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-ddc291a8-deb8-4f79-aeb8-9afa50fad872-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (90289924-4dd4-4dd0-a25d-42bf36e7a06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77560d63-c28c-4f52-82a0-9d4965862224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77560d63-c28c-4f52-82a0-9d4965862224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-817664862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cfe391-a675-42fe-a414-663a0ddcff4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95ac7fae97946389a85cfa97c873a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:22Z,use_quota=True,user_id='bcc4bab54965415098901cfb289c3c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759f08ba-5298-4bcb-a8d8-0d5f1ec490b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (759f08ba-5298-4bcb-a8d8-0d5f1ec490b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b1e6c6-6add-4cc5-ae1f-40bc424b7ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0b1e6c6-6add-4cc5-ae1f-40bc424b7ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cfe391-a675-42fe-a414-663a0ddcff4f', 'volume_name': 'volume-62cfe391-a675-42fe-a414-663a0ddcff4f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7554bff5-8c04-419f-b50e-3d11ffd94e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7554bff5-8c04-419f-b50e-3d11ffd94e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06234535-fd10-4450-88ed-7540b801a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:22 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Volume 62cfe391-a675-42fe-a414-663a0ddcff4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cfe391-a675-42fe-a414-663a0ddcff4f', 'volume_size': 1} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-817664862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cfe391-a675-42fe-a414-663a0ddcff4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95ac7fae97946389a85cfa97c873a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:22Z,use_quota=True,user_id='bcc4bab54965415098901cfb289c3c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Creating volume 62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:48:22 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:48:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:22 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f 1073741824 Jul 24 12:48:22 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:23 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f 1073741824" returned: 0 in 0.674s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:23 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f Jul 24 12:48:23 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:23 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f" returned: 0 in 0.422s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:48:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06234535-fd10-4450-88ed-7540b801a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cfe391-a675-42fe-a414-663a0ddcff4f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfdeb53-1174-4142-89dd-2a00a21b7c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Volume volume-62cfe391-a675-42fe-a414-663a0ddcff4f (62cfe391-a675-42fe-a414-663a0ddcff4f): created successfully Jul 24 12:48:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfdeb53-1174-4142-89dd-2a00a21b7c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (90289924-4dd4-4dd0-a25d-42bf36e7a06f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b29a3430-aab7-4bbc-8d18-36bc1c6e1f20 tempest-VolumesSnapshotTestJSON-824965014 None] Created volume successfully. Jul 24 12:48:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Creating offline snapshot 09f198ca-feb9-4b43-91fc-097feae7cdbb of volume 62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:48:24 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ece3d5-0207-442e-a45d-0bc516dcf159]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:24 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f Jul 24 12:48:24 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:25 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f" returned: 0 in 0.431s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:25 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb 1G Jul 24 12:48:25 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:25 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb 1G" returned: 0 in 0.574s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cfe391-a675-42fe-a414-663a0ddcff4f -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:25 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cfe391-a675-42fe-a414-663a0ddcff4f -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb Jul 24 12:48:25 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:26 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cfe391-a675-42fe-a414-663a0ddcff4f -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb" returned: 0 in 0.406s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:26 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb is being set with open permissions: ugo+rw Jul 24 12:48:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:26 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb Jul 24 12:48:26 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:26 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb" returned: 0 in 0.321s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:26 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.info Jul 24 12:48:26 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:27 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.info" returned: 0 in 0.448s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:27 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.info is being set with open permissions: ugo+rw Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:27 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.info Jul 24 12:48:27 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Flow 'volume_create_manager' (ed9a2e40-7051-4f81-ae55-3b1d37615ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b25507-c755-44b5-95d1-32ad7a449f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b25507-c755-44b5-95d1-32ad7a449f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1971844888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3cd555-fbcb-404d-ac8e-811e75416f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068fdd43a8de4b55a616b90f34d5daab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:27Z,use_quota=True,user_id='2c9b9bcaff7c4511b2346abd4108cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72dcf897-1de1-41f2-90ee-e18067215826),volume_type_id=72dcf897-1de1-41f2-90ee-e18067215826)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5520e303-960d-4c86-9062-f9c261030c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5520e303-960d-4c86-9062-f9c261030c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1df4210-a349-41d6-95ee-48fd5e847c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1df4210-a349-41d6-95ee-48fd5e847c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d3cd555-fbcb-404d-ac8e-811e75416f29', 'volume_name': 'volume-8d3cd555-fbcb-404d-ac8e-811e75416f29', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8784789d-c6d7-4bcc-8014-4416e8099a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8784789d-c6d7-4bcc-8014-4416e8099a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6022475b-3afe-42a4-bd40-32e3870402f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:27 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Volume 8d3cd555-fbcb-404d-ac8e-811e75416f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d3cd555-fbcb-404d-ac8e-811e75416f29', 'volume_size': 1} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:27 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.info" returned: 0 in 0.286s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.154s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1971844888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d3cd555-fbcb-404d-ac8e-811e75416f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='068fdd43a8de4b55a616b90f34d5daab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:27Z,use_quota=True,user_id='2c9b9bcaff7c4511b2346abd4108cc07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72dcf897-1de1-41f2-90ee-e18067215826),volume_type_id=72dcf897-1de1-41f2-90ee-e18067215826)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Creating volume 8d3cd555-fbcb-404d-ac8e-811e75416f29 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:48:27 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:27 devstack sudo[99810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 1073741824 Jul 24 12:48:27 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-753c08b3-9d60-42e2-bcdc-ab9f21db7a9e tempest-VolumesSnapshotTestJSON-824965014 None] Create snapshot completed successfully Jul 24 12:48:27 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 1073741824" returned: 0 in 0.537s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:28 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 Jul 24 12:48:28 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:28 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29" returned: 0 in 0.391s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6022475b-3afe-42a4-bd40-32e3870402f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d3cd555-fbcb-404d-ac8e-811e75416f29', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c0fd8e-5b37-4491-b270-df5fa61a21b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:28 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Volume volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 (8d3cd555-fbcb-404d-ac8e-811e75416f29): created successfully Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1c0fd8e-5b37-4491-b270-df5fa61a21b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Flow 'volume_create_manager' (ed9a2e40-7051-4f81-ae55-3b1d37615ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-46839b76-c982-45ce-b80b-114e0f87d801 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Created volume successfully. Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (ce573003-b8ab-4df7-be5b-8b1d047de4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c686adb7-c904-49c8-ad56-8294cf8b83ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c686adb7-c904-49c8-ad56-8294cf8b83ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-421574015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f931f60f-e076-4c17-875d-87ce3a62bc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95ac7fae97946389a85cfa97c873a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=09f198ca-feb9-4b43-91fc-097feae7cdbb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:29Z,use_quota=True,user_id='bcc4bab54965415098901cfb289c3c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13259ade-6589-47dd-b421-6d1b81bd93b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13259ade-6589-47dd-b421-6d1b81bd93b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda08321-affb-4920-a408-ca78ac9bdf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dda08321-affb-4920-a408-ca78ac9bdf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f931f60f-e076-4c17-875d-87ce3a62bc7c', 'volume_name': 'volume-f931f60f-e076-4c17-875d-87ce3a62bc7c', 'volume_size': 2, 'snapshot_id': '09f198ca-feb9-4b43-91fc-097feae7cdbb'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f437d56-a728-4e30-8008-be96b60183a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f437d56-a728-4e30-8008-be96b60183a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd34bc8-b2fe-4527-abd8-679807bff53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:28 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Volume f931f60f-e076-4c17-875d-87ce3a62bc7c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f931f60f-e076-4c17-875d-87ce3a62bc7c', 'volume_size': 2, 'snapshot_id': '09f198ca-feb9-4b43-91fc-097feae7cdbb'} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-09f198ca-feb9-4b43-91fc-097feae7cdbb-f931f60f-e076-4c17-875d-87ce3a62bc7c" by "_create_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-09f198ca-feb9-4b43-91fc-097feae7cdbb-f931f60f-e076-4c17-875d-87ce3a62bc7c" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Creating volume f931f60f-e076-4c17-875d-87ce3a62bc7c from snapshot 09f198ca-feb9-4b43-91fc-097feae7cdbb {{(pid=88540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-f931f60f-e076-4c17-875d-87ce3a62bc7c" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-f931f60f-e076-4c17-875d-87ce3a62bc7c" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] snapshot: 09f198ca-feb9-4b43-91fc-097feae7cdbb, volume: f931f60f-e076-4c17-875d-87ce3a62bc7c, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca75ae9-92a3-400c-9471-c742808c944a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:29 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb Jul 24 12:48:29 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:29 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb" returned: 0 in 0.503s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62cfe391-a675-42fe-a414-663a0ddcff4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc1b227-cd32-4404-9c9d-5ffc3bcc4f5a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:29 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f Jul 24 12:48:29 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed27fb5c-0b07-40ab-884c-018e83d87ddc tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed27fb5c-0b07-40ab-884c-018e83d87ddc tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed27fb5c-0b07-40ab-884c-018e83d87ddc tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed27fb5c-0b07-40ab-884c-018e83d87ddc tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed27fb5c-0b07-40ab-884c-018e83d87ddc tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed27fb5c-0b07-40ab-884c-018e83d87ddc tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:29 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f" returned: 0 in 0.455s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:48:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:29 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:48:29 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:29 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c Jul 24 12:48:29 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:30 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed27fb5c-0b07-40ab-884c-018e83d87ddc tempest-VolumeRetypeWithoutMigrationTest-74628692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.474s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:30 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-ed27fb5c-0b07-40ab-884c-018e83d87ddc tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:48:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ed27fb5c-0b07-40ab-884c-018e83d87ddc tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Retype volume completed successfully. Jul 24 12:48:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Acquiring lock "cinder-8d3cd555-fbcb-404d-ac8e-811e75416f29-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "cinder-8d3cd555-fbcb-404d-ac8e-811e75416f29-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Acquiring lock "cinder-quobyte-8d3cd555-fbcb-404d-ac8e-811e75416f29" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "cinder-quobyte-8d3cd555-fbcb-404d-ac8e-811e75416f29" acquired by "delete_volume" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a9a1dd-afbf-4f59-bb60-ed699bc3b023]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:32 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 Jul 24 12:48:32 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:32 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29" returned: 0 in 1.154s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:32 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29 Jul 24 12:48:32 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:33 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8d3cd555-fbcb-404d-ac8e-811e75416f29" returned: 0 in 0.697s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "cinder-quobyte-8d3cd555-fbcb-404d-ac8e-811e75416f29" released by "delete_volume" :: held 1.981s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:33 devstack cinder-volume[88540]: WARNING cinder.quota [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:48:33 devstack cinder-volume[88540]: WARNING cinder.quota [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:48:33 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Created reservations ['3d69e992-a13d-40e4-8413-1aedf0a2d701', 'decf92dc-0e9f-40d9-ba3d-49ebfb2de51a', '7b36e689-d7df-4f5a-9346-f6b6afeecc30', 'f58e8936-18ec-4c63-bb27-5439a7946e65'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:48:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:34 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:48:34 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:34 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.446s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:34 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:48:34 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Deleted volume successfully. Jul 24 12:48:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0aea67c6-7912-4cb2-a666-9ed9df405624 tempest-VolumeRetypeWithoutMigrationTest-74628692 None] Lock "cinder-8d3cd555-fbcb-404d-ac8e-811e75416f29-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:36 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c" returned: 0 in 6.658s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:36 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9441af4b-368f-4027-a38b-01c3f733e8a7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:36 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f Jul 24 12:48:36 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:37 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f" returned: 0 in 0.719s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f, size 1024.00 MB, duration 6.66 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:48:37 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Converted 1024.00 MB image at 153.77 MB/s Jul 24 12:48:37 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c is being set with open permissions: ugo+rw Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:37 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c Jul 24 12:48:37 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:37 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c" returned: 0 in 0.269s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-f931f60f-e076-4c17-875d-87ce3a62bc7c" released by "_copy_volume_from_snapshot" :: held 8.721s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-09f198ca-feb9-4b43-91fc-097feae7cdbb-f931f60f-e076-4c17-875d-87ce3a62bc7c" released by "_create_volume_from_snapshot" :: held 8.758s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.773s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd34bc8-b2fe-4527-abd8-679807bff53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f931f60f-e076-4c17-875d-87ce3a62bc7c', 'volume_size': 2, 'snapshot_id': '09f198ca-feb9-4b43-91fc-097feae7cdbb'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf97b10e-aab1-415d-a406-57d69d0ad9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:37 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Volume volume-f931f60f-e076-4c17-875d-87ce3a62bc7c (f931f60f-e076-4c17-875d-87ce3a62bc7c): created successfully Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf97b10e-aab1-415d-a406-57d69d0ad9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (ce573003-b8ab-4df7-be5b-8b1d047de4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:37 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-04545aa3-1eee-4f10-bde4-25f0de694ac8 tempest-VolumesSnapshotTestJSON-824965014 None] Created volume successfully. Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-f931f60f-e076-4c17-875d-87ce3a62bc7c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-f931f60f-e076-4c17-875d-87ce3a62bc7c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-f931f60f-e076-4c17-875d-87ce3a62bc7c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-f931f60f-e076-4c17-875d-87ce3a62bc7c" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f9f27e-6dcc-4829-b341-5cd839aea50e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:38 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c Jul 24 12:48:38 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:38 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c" returned: 0 in 0.397s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:38 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c Jul 24 12:48:38 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:38 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f931f60f-e076-4c17-875d-87ce3a62bc7c" returned: 0 in 0.349s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-f931f60f-e076-4c17-875d-87ce3a62bc7c" released by "delete_volume" :: held 0.821s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Created reservations ['acaf777b-9616-432a-bd4f-7be1d92b1057', 'b0982f7f-5288-4d76-a3d2-4b193e50c0b1', '4f7053ef-a521-4417-81dd-dad7c09266fa', '1422562b-152c-407c-a438-3687f4b626a6'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:39 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:48:39 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-09f198ca-feb9-4b43-91fc-097feae7cdbb-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:39 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-09f198ca-feb9-4b43-91fc-097feae7cdbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-62cfe391-a675-42fe-a414-663a0ddcff4f" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.312s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:48:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Deleted volume successfully. Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-62cfe391-a675-42fe-a414-663a0ddcff4f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-09f198ca-feb9-4b43-91fc-097feae7cdbb" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-09f198ca-feb9-4b43-91fc-097feae7cdbb" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Deleting offline snapshot 09f198ca-feb9-4b43-91fc-097feae7cdbb of volume 62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] snapshot_file for this snap is: volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4d68c7a1-6045-49aa-b4fc-62d65177a7bd tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-f931f60f-e076-4c17-875d-87ce3a62bc7c-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[49abb7ee-6693-42f1-a0e0-649234c1a78a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:39 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb Jul 24 12:48:39 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:39 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb" returned: 0 in 0.496s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62cfe391-a675-42fe-a414-663a0ddcff4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3e434c-1d4e-4d31-8a8d-fb2e5f407c5e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:40 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f Jul 24 12:48:40 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:40 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f" returned: 0 in 0.443s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:40 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb Jul 24 12:48:40 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:40 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb" returned: 0 in 0.605s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:41 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb Jul 24 12:48:41 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:41 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f.09f198ca-feb9-4b43-91fc-097feae7cdbb" returned: 0 in 0.356s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-09f198ca-feb9-4b43-91fc-097feae7cdbb" released by "_delete_snapshot" :: held 2.080s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-62cfe391-a675-42fe-a414-663a0ddcff4f" released by "delete_snapshot" :: held 2.125s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:41 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Created reservations ['c9b60b7e-ebe7-40f4-ac6c-4d4e5aacf9f1', '61e42ead-733c-4d15-b007-6907be655901', '2ca438aa-1963-444d-9a94-73e1d8987d2c', '1d0d95c4-9c5f-468b-a08c-4b39c6ce418c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:48:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Delete snapshot completed successfully. Jul 24 12:48:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-22bfba6b-b110-4946-877a-232ee7f48f6f tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-09f198ca-feb9-4b43-91fc-097feae7cdbb-delete_snapshot" released by "delete_snapshot" :: held 2.442s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:42 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:48:42 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:42 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.457s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-62cfe391-a675-42fe-a414-663a0ddcff4f-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-62cfe391-a675-42fe-a414-663a0ddcff4f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-62cfe391-a675-42fe-a414-663a0ddcff4f" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-62cfe391-a675-42fe-a414-663a0ddcff4f" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:43 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d601a4c5-6ed5-4c6c-be52-a5bb73c84cfb]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:43 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f Jul 24 12:48:43 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:44 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f" returned: 0 in 0.931s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:44 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f Jul 24 12:48:44 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:44 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-62cfe391-a675-42fe-a414-663a0ddcff4f" returned: 0 in 0.395s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-62cfe391-a675-42fe-a414-663a0ddcff4f" released by "delete_volume" :: held 1.440s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Created reservations ['696c4919-0dbb-4677-b56a-c62cec3233e4', '4fe0415d-2cea-48fe-aafe-d7db262dfa30', 'f1eaf81e-3795-4cff-9f92-a2a4013d13c1', 'e70fd246-0b15-4181-8e03-ee04717fb15e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:44 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:48:44 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:45 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.388s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:45 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:48:45 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Deleted volume successfully. Jul 24 12:48:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0fd30926-5df4-4d20-baca-45be40ca4267 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-62cfe391-a675-42fe-a414-663a0ddcff4f-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (c70a7086-a47c-44f3-86c6-32767ac83c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905a2bd2-2e10-43fe-a62e-6c78eeb79d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (905a2bd2-2e10-43fe-a62e-6c78eeb79d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-644568900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec1e0d8-0def-4c94-93bb-2881d85009f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95ac7fae97946389a85cfa97c873a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:46Z,use_quota=True,user_id='bcc4bab54965415098901cfb289c3c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55d4c0f-aade-4096-9047-da8439a50ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b55d4c0f-aade-4096-9047-da8439a50ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a741b5a-9ab9-451f-84a1-fb7a02b1826f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a741b5a-9ab9-451f-84a1-fb7a02b1826f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ec1e0d8-0def-4c94-93bb-2881d85009f4', 'volume_name': 'volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f28e603-85ab-4b86-9d1d-5796a740a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f28e603-85ab-4b86-9d1d-5796a740a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff931af-15cf-440f-8cd2-ba9d2d590e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:46 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Volume 8ec1e0d8-0def-4c94-93bb-2881d85009f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4', 'volume_size': 1} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-644568900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec1e0d8-0def-4c94-93bb-2881d85009f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95ac7fae97946389a85cfa97c873a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:46Z,use_quota=True,user_id='bcc4bab54965415098901cfb289c3c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Creating volume 8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:48:46 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:48:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:46 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 1073741824 Jul 24 12:48:46 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Flow 'volume_create_manager' (595f6cae-1dcd-42bc-bf80-3851ad1c68ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c143ec8-c0f5-491d-bdbd-7d91c1d9925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c143ec8-c0f5-491d-bdbd-7d91c1d9925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1998816980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429d3ff5-b223-4d2a-8fcb-331a1059034a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ecdd449ba54b7887aafe8533bf6744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:47Z,use_quota=True,user_id='e1153104b18c4c04b342cff356b59a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac7da6-cbd0-48e5-b3bb-4141014623ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bac7da6-cbd0-48e5-b3bb-4141014623ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eee4c59-555e-4e5b-9fa2-9210997a3bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eee4c59-555e-4e5b-9fa2-9210997a3bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429d3ff5-b223-4d2a-8fcb-331a1059034a', 'volume_name': 'volume-429d3ff5-b223-4d2a-8fcb-331a1059034a', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c17b378-de90-4432-af0d-4699f3a701dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c17b378-de90-4432-af0d-4699f3a701dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de81745e-120e-40b9-8b3c-9d88c428ad3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:47 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Volume 429d3ff5-b223-4d2a-8fcb-331a1059034a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429d3ff5-b223-4d2a-8fcb-331a1059034a', 'volume_size': 1} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:47 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 1073741824" returned: 0 in 0.933s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:47 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 Jul 24 12:48:47 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:47 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4" returned: 0 in 0.318s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.417s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1998816980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429d3ff5-b223-4d2a-8fcb-331a1059034a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5ecdd449ba54b7887aafe8533bf6744',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:47Z,use_quota=True,user_id='e1153104b18c4c04b342cff356b59a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Creating volume 429d3ff5-b223-4d2a-8fcb-331a1059034a {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:48:47 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:47 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a 1073741824 Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff931af-15cf-440f-8cd2-ba9d2d590e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:47 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82357568-bd69-4cdc-b8c6-fa9a9a736a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:47 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Volume volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 (8ec1e0d8-0def-4c94-93bb-2881d85009f4): created successfully Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82357568-bd69-4cdc-b8c6-fa9a9a736a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (c70a7086-a47c-44f3-86c6-32767ac83c12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:47 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-14d02456-0388-4d2b-b470-9014322fa012 tempest-VolumesSnapshotTestJSON-824965014 None] Created volume successfully. Jul 24 12:48:48 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a 1073741824" returned: 0 in 0.638s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:48 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a Jul 24 12:48:48 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Flow 'volume_create_manager' (8a2cdd68-c4dd-4c8d-9c01-0fe901b6d30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ddbdef-254c-421d-947a-8fa2257d48a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ddbdef-254c-421d-947a-8fa2257d48a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1929547569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f45d70-ec0f-41bf-bce9-a481672894af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908d959192224251a6a1a43b86d75364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:49Z,use_quota=True,user_id='a5826edd2f9743978f989464d5475c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd05f65-520c-4b53-9c1d-1bdd163f7765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd05f65-520c-4b53-9c1d-1bdd163f7765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7614dcc4-36b9-46f1-b5be-e554a8c23081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7614dcc4-36b9-46f1-b5be-e554a8c23081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43f45d70-ec0f-41bf-bce9-a481672894af', 'volume_name': 'volume-43f45d70-ec0f-41bf-bce9-a481672894af', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4e85da-7326-4ffd-bca3-a67297466256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4e85da-7326-4ffd-bca3-a67297466256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9ff02d-d906-428a-bf87-a6cb8a637308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:48 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Volume 43f45d70-ec0f-41bf-bce9-a481672894af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43f45d70-ec0f-41bf-bce9-a481672894af', 'volume_size': 1} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:48 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a" returned: 0 in 0.404s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:48:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1929547569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43f45d70-ec0f-41bf-bce9-a481672894af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908d959192224251a6a1a43b86d75364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:49Z,use_quota=True,user_id='a5826edd2f9743978f989464d5475c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Creating volume 43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:48:49 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de81745e-120e-40b9-8b3c-9d88c428ad3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429d3ff5-b223-4d2a-8fcb-331a1059034a', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:49 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af 1073741824 Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847d87ff-7eb8-4923-98b1-b519a884d059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:49 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:49 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Volume volume-429d3ff5-b223-4d2a-8fcb-331a1059034a (429d3ff5-b223-4d2a-8fcb-331a1059034a): created successfully Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847d87ff-7eb8-4923-98b1-b519a884d059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Flow 'volume_create_manager' (595f6cae-1dcd-42bc-bf80-3851ad1c68ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:49 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3a92d1b1-7e3d-4701-9424-ca1011f22042 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Created volume successfully. Jul 24 12:48:49 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af 1073741824" returned: 0 in 0.729s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:49 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af Jul 24 12:48:49 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:50 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af" returned: 0 in 0.346s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.259s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9ff02d-d906-428a-bf87-a6cb8a637308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43f45d70-ec0f-41bf-bce9-a481672894af', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77eddf84-4614-4fb2-acd8-f2adb1d1d589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Creating offline snapshot 21a0deef-6b22-45e3-8200-2d19d6adfb38 of volume 8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:48:50 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Volume volume-43f45d70-ec0f-41bf-bce9-a481672894af (43f45d70-ec0f-41bf-bce9-a481672894af): created successfully Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77eddf84-4614-4fb2-acd8-f2adb1d1d589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Flow 'volume_create_manager' (8a2cdd68-c4dd-4c8d-9c01-0fe901b6d30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[19db61f7-8797-4e5c-a844-c02cb7bd600f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:50 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7bfa7ca9-4d39-45c8-a344-8cf57e08c1e9 tempest-TestStampPattern-914984710 None] Created volume successfully. Jul 24 12:48:50 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 Jul 24 12:48:50 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:50 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4" returned: 0 in 0.449s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:50 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 1G Jul 24 12:48:50 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:51 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 1G" returned: 0 in 0.638s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:51 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 Jul 24 12:48:51 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:51 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38" returned: 0 in 0.492s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:51 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 is being set with open permissions: ugo+rw Jul 24 12:48:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:51 devstack sudo[100114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 Jul 24 12:48:51 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:52 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38" returned: 0 in 0.469s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:52 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.info Jul 24 12:48:52 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:52 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.info" returned: 0 in 0.350s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:52 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.info is being set with open permissions: ugo+rw Jul 24 12:48:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:52 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.info Jul 24 12:48:52 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:52 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.info" returned: 0 in 0.260s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.799s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.107s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Creating offline snapshot 5bf9a287-0dcb-4073-9749-67f265e22b86 of volume 429d3ff5-b223-4d2a-8fcb-331a1059034a {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:48:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9ed37afa-2de9-440a-aa57-a28e7c4d1a2c tempest-VolumesSnapshotTestJSON-824965014 None] Create snapshot completed successfully Jul 24 12:48:53 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db1bbaa-c716-4784-ac36-932432197091]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:53 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a Jul 24 12:48:53 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:53 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a" returned: 0 in 0.410s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:53 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 1G Jul 24 12:48:53 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:53 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 1G" returned: 0 in 0.471s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429d3ff5-b223-4d2a-8fcb-331a1059034a -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:53 devstack sudo[100147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429d3ff5-b223-4d2a-8fcb-331a1059034a -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 Jul 24 12:48:53 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:54 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-429d3ff5-b223-4d2a-8fcb-331a1059034a -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86" returned: 0 in 0.370s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:54 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 is being set with open permissions: ugo+rw Jul 24 12:48:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:54 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 Jul 24 12:48:54 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:54 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86" returned: 0 in 0.426s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:54 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.info Jul 24 12:48:54 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (c6cd3a74-9944-40b6-9aab-843ad0c4fd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcddd43-9031-4909-914f-feb563dde77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bcddd43-9031-4909-914f-feb563dde77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2024982387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d61a130-0d85-4e94-876d-95987889e85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c95ac7fae97946389a85cfa97c873a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=21a0deef-6b22-45e3-8200-2d19d6adfb38,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:48:55Z,use_quota=True,user_id='bcc4bab54965415098901cfb289c3c88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4019d459-1e21-42c7-8b23-c46dba48a3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4019d459-1e21-42c7-8b23-c46dba48a3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e7baad-7ea9-46c1-8cca-b9d1bdf81812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e7baad-7ea9-46c1-8cca-b9d1bdf81812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d61a130-0d85-4e94-876d-95987889e85f', 'volume_name': 'volume-2d61a130-0d85-4e94-876d-95987889e85f', 'volume_size': 1, 'snapshot_id': '21a0deef-6b22-45e3-8200-2d19d6adfb38'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86d97c8-0358-412a-88ed-3913f6e30634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86d97c8-0358-412a-88ed-3913f6e30634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a025b67-da00-4d81-88ba-7d31777e525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:48:55 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Volume 2d61a130-0d85-4e94-876d-95987889e85f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d61a130-0d85-4e94-876d-95987889e85f', 'volume_size': 1, 'snapshot_id': '21a0deef-6b22-45e3-8200-2d19d6adfb38'} Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:55 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.info" returned: 0 in 0.750s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:55 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.info is being set with open permissions: ugo+rw Jul 24 12:48:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:55 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.info Jul 24 12:48:55 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:56 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.info" returned: 0 in 0.469s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.136s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.585s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-21a0deef-6b22-45e3-8200-2d19d6adfb38-2d61a130-0d85-4e94-876d-95987889e85f" by "_create_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-21a0deef-6b22-45e3-8200-2d19d6adfb38-2d61a130-0d85-4e94-876d-95987889e85f" acquired by "_create_volume_from_snapshot" :: waited 0.074s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Creating volume 2d61a130-0d85-4e94-876d-95987889e85f from snapshot 21a0deef-6b22-45e3-8200-2d19d6adfb38 {{(pid=88540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-2d61a130-0d85-4e94-876d-95987889e85f" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-904c4aa7-1f23-4f16-ac12-e1688e059164 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Create snapshot completed successfully Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-2d61a130-0d85-4e94-876d-95987889e85f" acquired by "_copy_volume_from_snapshot" :: waited 0.069s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] snapshot: 21a0deef-6b22-45e3-8200-2d19d6adfb38, volume: 2d61a130-0d85-4e94-876d-95987889e85f, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1d60c3-6f8a-4e70-af9c-bac5f74e033f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:56 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 Jul 24 12:48:56 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:56 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38" returned: 0 in 0.444s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[823d5d4d-4c32-4c02-918d-3db93ba4c7de]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:57 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 Jul 24 12:48:57 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:57 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4" returned: 0 in 0.416s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:57 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f Jul 24 12:48:57 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Acquiring lock "cinder-5bf9a287-0dcb-4073-9749-67f265e22b86-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-5bf9a287-0dcb-4073-9749-67f265e22b86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Acquiring lock "cinder-quobyte-429d3ff5-b223-4d2a-8fcb-331a1059034a" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-quobyte-429d3ff5-b223-4d2a-8fcb-331a1059034a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Acquiring lock "cinder-quobyte-5bf9a287-0dcb-4073-9749-67f265e22b86" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-quobyte-5bf9a287-0dcb-4073-9749-67f265e22b86" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Deleting offline snapshot 5bf9a287-0dcb-4073-9749-67f265e22b86 of volume 429d3ff5-b223-4d2a-8fcb-331a1059034a {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] snapshot_file for this snap is: volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9fe497-88c4-4a62-ab78-724cae186b34]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:58 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 Jul 24 12:48:58 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:48:58 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 24 12:48:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86" returned: 0 in 0.844s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:48:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-429d3ff5-b223-4d2a-8fcb-331a1059034a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:48:58 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0f8efb-e272-4872-8906-f2944a8bd9b5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:48:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:48:59 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a Jul 24 12:48:59 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:00 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a" returned: 0 in 1.574s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:00 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 Jul 24 12:49:00 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:01 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86" returned: 0 in 0.983s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:01 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86 Jul 24 12:49:01 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:02 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a.5bf9a287-0dcb-4073-9749-67f265e22b86" returned: 0 in 0.864s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-quobyte-5bf9a287-0dcb-4073-9749-67f265e22b86" released by "_delete_snapshot" :: held 4.598s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-quobyte-429d3ff5-b223-4d2a-8fcb-331a1059034a" released by "delete_snapshot" :: held 4.660s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:02 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Created reservations ['69355381-793a-411f-ad9a-5b75c3bfa6e1', 'dba0afab-5743-4e92-9088-7df846d97320', '5c9669db-1c5b-4aa0-a6b3-72e990d01a5a', '9af2af0b-e0e9-4531-ae33-dafe4dfe67b2'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:02 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Delete snapshot completed successfully. Jul 24 12:49:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0240c1b8-03d5-4c56-971f-4089cc412c18 tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-5bf9a287-0dcb-4073-9749-67f265e22b86-delete_snapshot" released by "delete_snapshot" :: held 5.127s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Acquiring lock "cinder-429d3ff5-b223-4d2a-8fcb-331a1059034a-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-429d3ff5-b223-4d2a-8fcb-331a1059034a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Acquiring lock "cinder-quobyte-429d3ff5-b223-4d2a-8fcb-331a1059034a" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-quobyte-429d3ff5-b223-4d2a-8fcb-331a1059034a" acquired by "delete_volume" :: waited 0.065s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:04 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfcfa9b-440c-4372-a80b-db4569c32677]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:04 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f" returned: 0 in 7.146s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:04 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab83429-882f-4c0a-8f27-4b8db145d368]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:04 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a Jul 24 12:49:04 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:04 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 Jul 24 12:49:04 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:04 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a" returned: 0 in 0.585s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:05 devstack sudo[100316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a Jul 24 12:49:05 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:05 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4" returned: 0 in 0.885s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4, size 1024.00 MB, duration 7.15 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:49:05 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Converted 1024.00 MB image at 143.27 MB/s Jul 24 12:49:05 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f is being set with open permissions: ugo+rw Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:05 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f Jul 24 12:49:05 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:05 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-429d3ff5-b223-4d2a-8fcb-331a1059034a" returned: 0 in 0.630s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-quobyte-429d3ff5-b223-4d2a-8fcb-331a1059034a" released by "delete_volume" :: held 1.445s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Created reservations ['71606307-d43b-4d9e-9885-57338a16b333', '93b46988-3648-410e-b487-55ceb5ea80ce', '977d4061-70fd-40f1-8892-34955eff89cf', '2ae98581-da48-41d6-a75c-2dd2f66f782f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:05 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f" returned: 0 in 0.405s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-2d61a130-0d85-4e94-876d-95987889e85f" released by "_copy_volume_from_snapshot" :: held 9.522s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-21a0deef-6b22-45e3-8200-2d19d6adfb38-2d61a130-0d85-4e94-876d-95987889e85f" released by "_create_volume_from_snapshot" :: held 9.656s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.736s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a025b67-da00-4d81-88ba-7d31777e525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d61a130-0d85-4e94-876d-95987889e85f', 'volume_size': 1, 'snapshot_id': '21a0deef-6b22-45e3-8200-2d19d6adfb38'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289917a4-ac37-4ebb-9305-e382a29fb78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:05 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Volume volume-2d61a130-0d85-4e94-876d-95987889e85f (2d61a130-0d85-4e94-876d-95987889e85f): created successfully Jul 24 12:49:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289917a4-ac37-4ebb-9305-e382a29fb78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Flow 'volume_create_manager' (c6cd3a74-9944-40b6-9aab-843ad0c4fd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cd14c67d-846e-4586-87b8-566d700a9c4e tempest-VolumesSnapshotTestJSON-824965014 None] Created volume successfully. Jul 24 12:49:06 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:49:06 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:06 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:49:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Deleted volume successfully. Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-38a524bb-900d-42c4-916a-aec3cf59c09d tempest-VolumeSnapshotQuotasNegativeTestJSON-514287540 None] Lock "cinder-429d3ff5-b223-4d2a-8fcb-331a1059034a-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-2d61a130-0d85-4e94-876d-95987889e85f-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-2d61a130-0d85-4e94-876d-95987889e85f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-2d61a130-0d85-4e94-876d-95987889e85f" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-2d61a130-0d85-4e94-876d-95987889e85f" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a5a8f3-c266-4e94-a499-b4988ce47ffa]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:07 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f Jul 24 12:49:07 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:07 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f" returned: 0 in 0.604s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:07 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f Jul 24 12:49:07 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:07 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2d61a130-0d85-4e94-876d-95987889e85f" returned: 0 in 0.344s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-2d61a130-0d85-4e94-876d-95987889e85f" released by "delete_volume" :: held 1.026s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=89,cinder:SELECT=78,cinder:INSERT=18,cinder:DELETE=6 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Created reservations ['1f02cdd5-eeed-4e39-9911-dbfe7014dc0d', 'bffbeb75-1093-48bb-9dc9-15446a6a9fac', '54d69eb3-9762-48ec-a9d5-205b85b39e50', '2395fabd-4f92-4f3a-9e42-f4510d0750cf'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:08 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:49:08 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:08 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.446s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=92,cinder:UPDATE=83,cinder:INSERT=24,cinder:DELETE=10 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:49:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Deleted volume successfully. Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Flow 'volume_create_manager' (4ae3d570-2940-466c-99fd-cdb5818adc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5827a49-d009-4bd4-badf-d62776352f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-60d96ff0-c24c-4054-83aa-5efd5d1e5c1c tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-2d61a130-0d85-4e94-876d-95987889e85f-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5827a49-d009-4bd4-badf-d62776352f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1766972604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04063884-3be6-4856-b9c4-93264fa4131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a428ad79bc21469c98b25ecf8307cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:09Z,use_quota=True,user_id='53d457c054a54a80b4c3df221d44f88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f399a24-cb2d-4d51-909c-d5cb32a531f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f399a24-cb2d-4d51-909c-d5cb32a531f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b5230d-48a0-44cc-9790-44995716b837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b5230d-48a0-44cc-9790-44995716b837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04063884-3be6-4856-b9c4-93264fa4131f', 'volume_name': 'volume-04063884-3be6-4856-b9c4-93264fa4131f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b3c2a8-2e24-4bb3-8fdc-b7855bdbae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b3c2a8-2e24-4bb3-8fdc-b7855bdbae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc52020-38df-4dd2-9932-16e963ac7845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:08 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Volume 04063884-3be6-4856-b9c4-93264fa4131f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04063884-3be6-4856-b9c4-93264fa4131f', 'volume_size': 1} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1766972604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04063884-3be6-4856-b9c4-93264fa4131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a428ad79bc21469c98b25ecf8307cbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:09Z,use_quota=True,user_id='53d457c054a54a80b4c3df221d44f88d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Creating volume 04063884-3be6-4856-b9c4-93264fa4131f {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:08 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:08 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f 1073741824 Jul 24 12:49:08 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-21a0deef-6b22-45e3-8200-2d19d6adfb38-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-21a0deef-6b22-45e3-8200-2d19d6adfb38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-8ec1e0d8-0def-4c94-93bb-2881d85009f4" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-8ec1e0d8-0def-4c94-93bb-2881d85009f4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-21a0deef-6b22-45e3-8200-2d19d6adfb38" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-21a0deef-6b22-45e3-8200-2d19d6adfb38" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Deleting offline snapshot 21a0deef-6b22-45e3-8200-2d19d6adfb38 of volume 8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] snapshot_file for this snap is: volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[471cb7e1-d072-4c27-a71f-f63a8a735cff]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:09 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f 1073741824" returned: 0 in 0.621s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:09 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 Jul 24 12:49:09 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:09 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f Jul 24 12:49:09 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:09 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38" returned: 0 in 0.609s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[85acd59b-d348-4372-bda4-b144fb795e68]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:09 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f" returned: 0 in 0.511s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdc52020-38df-4dd2-9932-16e963ac7845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04063884-3be6-4856-b9c4-93264fa4131f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9947f788-1bd1-486b-a33f-047d82a1d586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:10 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Volume volume-04063884-3be6-4856-b9c4-93264fa4131f (04063884-3be6-4856-b9c4-93264fa4131f): created successfully Jul 24 12:49:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9947f788-1bd1-486b-a33f-047d82a1d586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Flow 'volume_create_manager' (4ae3d570-2940-466c-99fd-cdb5818adc8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8e9db32f-5abc-48dc-b620-6bd1ae8f6fd8 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Created volume successfully. Jul 24 12:49:10 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 Jul 24 12:49:10 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:10 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4" returned: 0 in 0.417s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:10 devstack sudo[100379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 Jul 24 12:49:10 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:10 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38" returned: 0 in 0.378s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:10 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38 Jul 24 12:49:10 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:10 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4.21a0deef-6b22-45e3-8200-2d19d6adfb38" returned: 0 in 0.257s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-21a0deef-6b22-45e3-8200-2d19d6adfb38" released by "_delete_snapshot" :: held 1.783s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-8ec1e0d8-0def-4c94-93bb-2881d85009f4" released by "delete_snapshot" :: held 1.816s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Created reservations ['e7654965-efd0-491e-b036-88caeaf55b44', '94fc643c-6568-49e8-a6b2-cb98a5b37a5c', 'f1845756-edd3-406a-8e2a-e5d219b047b9', 'a72b0e2c-a801-425e-92d8-4cc34e6fee0a'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:11 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Delete snapshot completed successfully. Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6866fc7-256e-47d8-9c09-652066a57777 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-21a0deef-6b22-45e3-8200-2d19d6adfb38-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-8ec1e0d8-0def-4c94-93bb-2881d85009f4-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-8ec1e0d8-0def-4c94-93bb-2881d85009f4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-8ec1e0d8-0def-4c94-93bb-2881d85009f4" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-5f50caad-8274-46e2-8573-684a6f51f331 req-53347414-efdb-4965-ae80-0791ef374c8f tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-5f50caad-8274-46e2-8573-684a6f51f331 req-53347414-efdb-4965-ae80-0791ef374c8f tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-8ec1e0d8-0def-4c94-93bb-2881d85009f4" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-5f50caad-8274-46e2-8573-684a6f51f331 req-53347414-efdb-4965-ae80-0791ef374c8f tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b9eea5-fb75-456e-8413-be0fea7c981c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-5f50caad-8274-46e2-8573-684a6f51f331 req-53347414-efdb-4965-ae80-0791ef374c8f tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-04063884-3be6-4856-b9c4-93264fa4131f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6786531e-c2d9-4fc6-ab38-c6af1e408e4c', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:49:11 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-5f50caad-8274-46e2-8573-684a6f51f331 req-53347414-efdb-4965-ae80-0791ef374c8f tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] attachment_update completed successfully. Jul 24 12:49:11 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 Jul 24 12:49:11 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:12 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4" returned: 0 in 0.414s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:12 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4 Jul 24 12:49:12 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:12 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8ec1e0d8-0def-4c94-93bb-2881d85009f4" returned: 0 in 0.276s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-8ec1e0d8-0def-4c94-93bb-2881d85009f4" released by "delete_volume" :: held 0.769s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Created reservations ['b536b239-5d77-441c-9e50-07e6cdfd2658', '46e5f01b-aa93-45da-b9ee-af06974bbcc9', 'd6ec77ca-adc0-4223-a591-9ac9ad3c15f9', '822cde0a-95b5-496b-86d1-7d5ba567bc81'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:12 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:49:12 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-b44b4434-cd5a-4892-b734-3632f980ec88-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-b44b4434-cd5a-4892-b734-3632f980ec88-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "cinder-quobyte-b44b4434-cd5a-4892-b734-3632f980ec88" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-b44b4434-cd5a-4892-b734-3632f980ec88" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[503feda3-6311-438e-8d95-40cc27344025]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:12 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.438s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:49:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Deleted volume successfully. Jul 24 12:49:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cbdd7bf-b015-43a1-b23f-89cf5a1021ce tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-8ec1e0d8-0def-4c94-93bb-2881d85009f4-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:13 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 Jul 24 12:49:13 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:13 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88" returned: 0 in 0.369s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:13 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88 Jul 24 12:49:13 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:13 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b44b4434-cd5a-4892-b734-3632f980ec88" returned: 0 in 0.246s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-quobyte-b44b4434-cd5a-4892-b734-3632f980ec88" released by "delete_volume" :: held 0.694s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Created reservations ['cb45a40d-3dce-42e3-bcce-5c4e0fcebde4', 'b8e75f1f-a5d0-4103-b80d-5d8d32b9661e', '652e5468-5849-4af5-a3da-131241ab4c86', 'bd2d59b6-8ec3-4694-8931-3393a85867a3'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:13 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:49:13 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:13 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.276s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:13 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:49:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Deleted volume successfully. Jul 24 12:49:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c404d1a7-9fb5-4966-94b4-0dae6c639f76 tempest-VolumesSnapshotTestJSON-824965014 None] Lock "cinder-b44b4434-cd5a-4892-b734-3632f980ec88-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-3cdd1c86-514d-48fc-8b37-2b1401a345e3 req-f2cf8259-2b6f-494c-ba69-ee29468771eb tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Terminate volume connection completed successfully. Jul 24 12:49:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-3cdd1c86-514d-48fc-8b37-2b1401a345e3 req-f2cf8259-2b6f-494c-ba69-ee29468771eb tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Deleting attachment 6786531e-c2d9-4fc6-ab38-c6af1e408e4c. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:49:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Acquiring lock "cinder-04063884-3be6-4856-b9c4-93264fa4131f-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "cinder-04063884-3be6-4856-b9c4-93264fa4131f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Acquiring lock "cinder-quobyte-04063884-3be6-4856-b9c4-93264fa4131f" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "cinder-quobyte-04063884-3be6-4856-b9c4-93264fa4131f" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:16 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e34db22-b6a6-4f27-aa12-80003011065b]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:16 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f Jul 24 12:49:16 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:17 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f" returned: 0 in 0.515s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:17 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f Jul 24 12:49:17 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:17 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04063884-3be6-4856-b9c4-93264fa4131f" returned: 0 in 0.297s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "cinder-quobyte-04063884-3be6-4856-b9c4-93264fa4131f" released by "delete_volume" :: held 0.854s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Created reservations ['cf03b35f-3467-4a8e-9338-398b78f7cabf', '8c217a2f-673e-4b27-adbf-3b27d64c76b5', '26362381-befa-4657-b949-891d646328b3', '367bf228-1d68-4d07-bfdc-97b8d3ec1b29'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:17 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:49:17 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:18 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.399s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:18 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:49:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Deleted volume successfully. Jul 24 12:49:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-32a2d238-9037-4bbb-8a58-785406e74c80 tempest-TestServerVolumeAttachScenarioOldVersion-753944990 None] Lock "cinder-04063884-3be6-4856-b9c4-93264fa4131f-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-eafcda0b-44c6-47fb-9483-3b395650d42c req-ec0c8b45-9fc9-4909-9625-4e48beff30df tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-eafcda0b-44c6-47fb-9483-3b395650d42c req-ec0c8b45-9fc9-4909-9625-4e48beff30df tempest-TestStampPattern-914984710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-eafcda0b-44c6-47fb-9483-3b395650d42c req-ec0c8b45-9fc9-4909-9625-4e48beff30df tempest-TestStampPattern-914984710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-eafcda0b-44c6-47fb-9483-3b395650d42c req-ec0c8b45-9fc9-4909-9625-4e48beff30df tempest-TestStampPattern-914984710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-43f45d70-ec0f-41bf-bce9-a481672894af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '047589c4-54fe-4023-997c-d4f734618c41', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:49:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-eafcda0b-44c6-47fb-9483-3b395650d42c req-ec0c8b45-9fc9-4909-9625-4e48beff30df tempest-TestStampPattern-914984710 None] attachment_update completed successfully. Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Flow 'volume_create_manager' (b1f65860-e84a-4a2f-bce9-2850694416f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd27fc9c-90d6-44ee-ae4e-040a6a05c22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd27fc9c-90d6-44ee-ae4e-040a6a05c22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1185839609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945e332b-68bf-4fca-9cf4-a1fc781a1f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b85f87d72d9435ba91ac13eed7930e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:22Z,use_quota=True,user_id='cf50c2d89dc3455789900398ed665453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f27b0b-8b64-4a91-95e6-96d73cc2a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3f27b0b-8b64-4a91-95e6-96d73cc2a417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b8a1d7-bfaa-40d0-87be-fe468507ea09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7b8a1d7-bfaa-40d0-87be-fe468507ea09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945e332b-68bf-4fca-9cf4-a1fc781a1f2c', 'volume_name': 'volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff99758-aa6d-4465-b3bb-48818776e19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff99758-aa6d-4465-b3bb-48818776e19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b9a13f-2d9a-4a3d-90af-61bf4067a834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:22 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Volume 945e332b-68bf-4fca-9cf4-a1fc781a1f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c', 'volume_size': 1} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1185839609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945e332b-68bf-4fca-9cf4-a1fc781a1f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b85f87d72d9435ba91ac13eed7930e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:22Z,use_quota=True,user_id='cf50c2d89dc3455789900398ed665453',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Creating volume 945e332b-68bf-4fca-9cf4-a1fc781a1f2c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:22 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:22 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c 1073741824 Jul 24 12:49:22 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:23 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c 1073741824" returned: 0 in 0.600s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:23 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c Jul 24 12:49:23 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:23 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" returned: 0 in 0.277s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b9a13f-2d9a-4a3d-90af-61bf4067a834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf689dcd-3ddc-4b2e-a9df-f8c8fd8c618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Volume volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c (945e332b-68bf-4fca-9cf4-a1fc781a1f2c): created successfully Jul 24 12:49:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf689dcd-3ddc-4b2e-a9df-f8c8fd8c618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Flow 'volume_create_manager' (b1f65860-e84a-4a2f-bce9-2850694416f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e5999d43-f76f-49ee-8775-f7bcce6815aa tempest-SnapshotMetadataTestJSON-1991651150 None] Created volume successfully. Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Flow 'volume_create_manager' (c4a22b1c-380f-4aa4-8a45-c10716e2049a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406eea6f-099c-4d01-8bfc-572a7b784756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (406eea6f-099c-4d01-8bfc-572a7b784756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1074752520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2ea3cd-3744-48e3-88a8-01ab1cbe286c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7539eae1f7a476ea400721aab38f1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:24Z,use_quota=True,user_id='773deed6fc454ebd82f23d6f6405a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475a7663-9564-4255-9c3b-9da56abe4f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (475a7663-9564-4255-9c3b-9da56abe4f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1225d74-5c74-4ce2-860d-3289bb288d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1225d74-5c74-4ce2-860d-3289bb288d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2ea3cd-3744-48e3-88a8-01ab1cbe286c', 'volume_name': 'volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c', 'volume_size': 2}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4514210c-88f0-4bf5-9c48-40f6b4dd5bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4514210c-88f0-4bf5-9c48-40f6b4dd5bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483cae2b-c92e-4ec8-8cf5-518c59c0dbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:24 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Volume aa2ea3cd-3744-48e3-88a8-01ab1cbe286c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c', 'volume_size': 2} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1074752520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2ea3cd-3744-48e3-88a8-01ab1cbe286c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7539eae1f7a476ea400721aab38f1f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:24Z,use_quota=True,user_id='773deed6fc454ebd82f23d6f6405a27e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Creating volume aa2ea3cd-3744-48e3-88a8-01ab1cbe286c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:24 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c 2147483648 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:24 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c 2147483648 Jul 24 12:49:24 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:24 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c 2147483648" returned: 0 in 0.701s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:25 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c Jul 24 12:49:25 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:25 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" returned: 0 in 0.298s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.378s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (483cae2b-c92e-4ec8-8cf5-518c59c0dbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c', 'volume_size': 2}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bb7594-e834-4a23-8b82-54cdfba63f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Creating offline snapshot 243fb80b-1674-4365-b658-1075644b187e of volume 945e332b-68bf-4fca-9cf4-a1fc781a1f2c {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:49:25 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Volume volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c (aa2ea3cd-3744-48e3-88a8-01ab1cbe286c): created successfully Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71bb7594-e834-4a23-8b82-54cdfba63f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Flow 'volume_create_manager' (c4a22b1c-380f-4aa4-8a45-c10716e2049a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f304f1ec-13c7-4165-bef4-0caa03cad611]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-33a9c37b-47e8-4134-81f3-64817477f889 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Created volume successfully. Jul 24 12:49:25 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c Jul 24 12:49:25 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-eea5da92-e924-4797-b3aa-6225aa65a863 req-36e31b53-2a42-46ce-a52f-a4ac12f8dae3 tempest-TestStampPattern-914984710 None] Terminate volume connection completed successfully. Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-eea5da92-e924-4797-b3aa-6225aa65a863 req-36e31b53-2a42-46ce-a52f-a4ac12f8dae3 tempest-TestStampPattern-914984710 None] Deleting attachment 047589c4-54fe-4023-997c-d4f734618c41. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:49:25 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" returned: 0 in 0.463s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:25 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e 1G Jul 24 12:49:25 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:26 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e 1G" returned: 0 in 0.581s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:26 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e Jul 24 12:49:26 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:26 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e" returned: 0 in 0.370s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:26 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e is being set with open permissions: ugo+rw Jul 24 12:49:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:26 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e Jul 24 12:49:26 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:27 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e" returned: 0 in 0.254s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:27 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.info Jul 24 12:49:27 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:27 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.info" returned: 0 in 0.300s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:27 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.info is being set with open permissions: ugo+rw Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:27 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.info Jul 24 12:49:27 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:27 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.info" returned: 0 in 0.260s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.381s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.054s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Creating offline snapshot 5a801085-9027-4ea6-9ead-5d1f6d55cbd8 of volume aa2ea3cd-3744-48e3-88a8-01ab1cbe286c {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:49:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c45fcbc5-7637-4a2b-89b1-f0d98639c018 tempest-SnapshotMetadataTestJSON-1991651150 None] Create snapshot completed successfully Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b451bc-53fc-4114-a107-86ffea1fbcc5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:27 devstack sudo[101376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c Jul 24 12:49:27 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:28 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" returned: 0 in 0.434s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 2G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:28 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 2G Jul 24 12:49:28 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:28 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 2G" returned: 0 in 0.520s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:28 devstack sudo[101387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 Jul 24 12:49:28 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Acquiring lock "cinder-243fb80b-1674-4365-b658-1075644b187e-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-243fb80b-1674-4365-b658-1075644b187e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Acquiring lock "cinder-quobyte-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-quobyte-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Acquiring lock "cinder-quobyte-243fb80b-1674-4365-b658-1075644b187e" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-quobyte-243fb80b-1674-4365-b658-1075644b187e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Deleting offline snapshot 243fb80b-1674-4365-b658-1075644b187e of volume 945e332b-68bf-4fca-9cf4-a1fc781a1f2c {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] snapshot_file for this snap is: volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[224d6944-cbc9-4f5c-a9e9-45357fe1d486]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:29 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8" returned: 0 in 0.368s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:29 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 is being set with open permissions: ugo+rw Jul 24 12:49:29 devstack sudo[101392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:29 devstack sudo[101392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:29 devstack sudo[101398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 Jul 24 12:49:29 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:29 devstack sudo[101392]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e" returned: 0 in 0.375s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:49:29 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8" returned: 0 in 0.273s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0890e2c3-2824-475f-b5cb-91fc3c6b398a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:29 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.info Jul 24 12:49:29 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:29 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c Jul 24 12:49:29 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:29 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.info" returned: 0 in 0.294s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:29 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.info is being set with open permissions: ugo+rw Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:29 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.info Jul 24 12:49:29 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:29 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" returned: 0 in 0.411s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:29 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e Jul 24 12:49:29 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:29 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.info" returned: 0 in 0.281s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.238s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Creating offline snapshot 6a9ad139-f947-4d40-a4df-9cddab92eec4 of volume 43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:49:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-667f4eba-54bc-4669-b3af-1d28ea2bfc28 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Create snapshot completed successfully Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[37df18b0-dd39-429a-859a-9261b416a019]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:30 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e" returned: 0 in 0.454s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:30 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af Jul 24 12:49:30 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:30 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e Jul 24 12:49:30 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:30 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c.243fb80b-1674-4365-b658-1075644b187e" returned: 0 in 0.274s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:30 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af" returned: 0 in 0.449s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:30 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 1G Jul 24 12:49:30 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-quobyte-243fb80b-1674-4365-b658-1075644b187e" released by "_delete_snapshot" :: held 1.648s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-quobyte-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" released by "delete_snapshot" :: held 1.677s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Created reservations ['75a00232-1b2f-4215-a136-68437016cb37', '20557365-6a58-402f-95ea-a336f6c09745', 'ace515d0-9ab1-4f85-ba1e-9583bd5a6431', 'de5ac138-4941-4a42-a76e-6a23dc099af9'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Delete snapshot completed successfully. Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe14eb89-c532-47e9-915c-8cbec32d8a05 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-243fb80b-1674-4365-b658-1075644b187e-delete_snapshot" released by "delete_snapshot" :: held 1.823s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Acquiring lock "cinder-5a801085-9027-4ea6-9ead-5d1f6d55cbd8-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-5a801085-9027-4ea6-9ead-5d1f6d55cbd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Acquiring lock "cinder-quobyte-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-quobyte-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Acquiring lock "cinder-quobyte-5a801085-9027-4ea6-9ead-5d1f6d55cbd8" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-quobyte-5a801085-9027-4ea6-9ead-5d1f6d55cbd8" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Deleting offline snapshot 5a801085-9027-4ea6-9ead-5d1f6d55cbd8 of volume aa2ea3cd-3744-48e3-88a8-01ab1cbe286c {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:49:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] snapshot_file for this snap is: volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8e7974-fd58-4bf2-b779-44ef38f1ca02]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:31 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 1G" returned: 0 in 0.541s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f45d70-ec0f-41bf-bce9-a481672894af -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:31 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f45d70-ec0f-41bf-bce9-a481672894af -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 Jul 24 12:49:31 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Acquiring lock "cinder-945e332b-68bf-4fca-9cf4-a1fc781a1f2c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-945e332b-68bf-4fca-9cf4-a1fc781a1f2c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:31 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 Jul 24 12:49:31 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Acquiring lock "cinder-quobyte-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-quobyte-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" acquired by "delete_volume" :: waited 0.018s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a16cf8-3781-4bba-9680-3f005827cbf1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:31 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c Jul 24 12:49:31 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:31 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43f45d70-ec0f-41bf-bce9-a481672894af -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4" returned: 0 in 0.452s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:31 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 is being set with open permissions: ugo+rw Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:31 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:31 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 Jul 24 12:49:31 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8" returned: 0 in 0.527s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b08b9c-48c6-4ef4-8ee5-5348b4d7c2aa]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:31 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c Jul 24 12:49:31 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:31 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4" returned: 0 in 0.298s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:31 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" returned: 0 in 0.484s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:31 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c Jul 24 12:49:31 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:31 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.info Jul 24 12:49:31 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:32 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" returned: 0 in 0.445s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:32 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 Jul 24 12:49:32 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:32 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" returned: 0 in 0.320s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-quobyte-945e332b-68bf-4fca-9cf4-a1fc781a1f2c" released by "delete_volume" :: held 0.895s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:32 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.info" returned: 0 in 0.343s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:32 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.info is being set with open permissions: ugo+rw Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:32 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.info Jul 24 12:49:32 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Created reservations ['9cc38c50-2150-4521-b5cb-73c72a70393d', 'e4e5714d-9c0f-409f-a4aa-53f1d64418d1', 'bf96df16-30e2-413a-8429-1a04843542b1', '091220ea-180d-4489-8876-4ba68f050da5'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:32 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:49:32 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:32 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8" returned: 0 in 0.471s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:32 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:32 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8 Jul 24 12:49:32 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.info" returned: 0 in 0.333s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-74791153-483b-42d9-8990-e2dffd8f5d7c tempest-TestStampPattern-914984710 None] Create snapshot completed successfully Jul 24 12:49:32 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.291s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:49:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Deleted volume successfully. Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1e451c31-48cf-4822-95a2-ce993b3521a6 tempest-SnapshotMetadataTestJSON-1991651150 None] Lock "cinder-945e332b-68bf-4fca-9cf4-a1fc781a1f2c-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:32 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c.5a801085-9027-4ea6-9ead-5d1f6d55cbd8" returned: 0 in 0.266s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-quobyte-5a801085-9027-4ea6-9ead-5d1f6d55cbd8" released by "_delete_snapshot" :: held 1.846s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-quobyte-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" released by "delete_snapshot" :: held 1.880s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Created reservations ['c1b642ce-8c3d-417e-906e-b2ed44b637f9', 'e5a6e2c8-e358-4c29-a65d-08cb37b22ec6', 'c8814fce-1128-49d1-89e2-1fd34d5609a9', 'f98ce7ed-615b-4d38-a1ca-7cd0057599e4'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Delete snapshot completed successfully. Jul 24 12:49:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-97d152a7-ccac-494f-a56f-a03852bc2eb9 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-5a801085-9027-4ea6-9ead-5d1f6d55cbd8-delete_snapshot" released by "delete_snapshot" :: held 2.034s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Acquiring lock "cinder-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Acquiring lock "cinder-quobyte-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-quobyte-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fa0daa-5de0-4567-94cd-ed936672e70a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:33 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c Jul 24 12:49:33 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:33 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" returned: 0 in 0.434s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:33 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c Jul 24 12:49:33 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:33 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-quobyte-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c" released by "delete_volume" :: held 0.756s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Created reservations ['00396561-938e-42cb-ba94-b9a804a4c526', '014ab945-b9a3-4f25-a052-5756b683f3d8', '0a4c6c20-783d-4a5d-a92b-e477fc341e82', '07d6a035-f1f1-46c5-b6ab-df7f0ade610f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:34 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:49:34 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:34 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.444s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:49:34 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Deleted volume successfully. Jul 24 12:49:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e299561-9d22-4ede-8dbe-3ee0cc345497 tempest-VolumesSnapshotNegativeTestJSON-2144821109 None] Lock "cinder-aa2ea3cd-3744-48e3-88a8-01ab1cbe286c-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:35 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (6cc7f1ad-6a7f-48b4-84a5-2f346304c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaae0ab-e60b-4f5f-9ad2-6dd99b9c45e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daaae0ab-e60b-4f5f-9ad2-6dd99b9c45e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457569430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9bdc26-51e0-46e8-874d-4b7e35158e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:36Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0496123-61fb-4a82-b329-a0d90e054536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0496123-61fb-4a82-b329-a0d90e054536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cd69aa-e4db-44b4-9a44-54adb0fc34b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73cd69aa-e4db-44b4-9a44-54adb0fc34b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f9bdc26-51e0-46e8-874d-4b7e35158e66', 'volume_name': 'volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d464d920-e6cc-4f38-8fe6-1796dffffb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d464d920-e6cc-4f38-8fe6-1796dffffb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b2299b-9b17-4788-b1ed-1db31fedd2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:36 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume 9f9bdc26-51e0-46e8-874d-4b7e35158e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66', 'volume_size': 1} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1457569430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f9bdc26-51e0-46e8-874d-4b7e35158e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:36Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Creating volume 9f9bdc26-51e0-46e8-874d-4b7e35158e66 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:36 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:36 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 1073741824 Jul 24 12:49:36 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:36 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 1073741824" returned: 0 in 0.573s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:36 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 Jul 24 12:49:36 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:37 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66" returned: 0 in 0.323s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b2299b-9b17-4788-b1ed-1db31fedd2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ef36d7-982a-4622-9b58-1c2a181ee408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:37 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 (9f9bdc26-51e0-46e8-874d-4b7e35158e66): created successfully Jul 24 12:49:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58ef36d7-982a-4622-9b58-1c2a181ee408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:37 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (6cc7f1ad-6a7f-48b4-84a5-2f346304c926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:37 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4b64b5ab-358c-4ca6-9bb8-34ee6b1fc066 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created volume successfully. Jul 24 12:49:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Creating offline snapshot 8df26082-631e-4c84-bd60-53b1f1709093 of volume 9f9bdc26-51e0-46e8-874d-4b7e35158e66 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:49:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[505c0dd0-a228-454f-9abd-43db5e6d22b0]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:38 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 Jul 24 12:49:38 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:38 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66" returned: 0 in 0.567s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:38 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 1G Jul 24 12:49:38 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Flow 'volume_create_manager' (24bc3655-7383-4d7c-b550-a055bca6d88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a2b135-7e92-456c-91a3-368e9f21da9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a2b135-7e92-456c-91a3-368e9f21da9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-180878114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32f2994-606f-4987-88e9-e7f8c478fba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da5cfd3a1b45788637cd9a69827cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:39Z,use_quota=True,user_id='f6f311d1e1a44ce6bcc55db8e6632261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b122019-1a91-4a0b-a207-40e4f2ad3c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b122019-1a91-4a0b-a207-40e4f2ad3c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8ef294-2c6e-41f2-94c7-9089cf7211b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8ef294-2c6e-41f2-94c7-9089cf7211b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32f2994-606f-4987-88e9-e7f8c478fba8', 'volume_name': 'volume-f32f2994-606f-4987-88e9-e7f8c478fba8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87414a8-0c7f-4d9a-bedd-f827837680e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b87414a8-0c7f-4d9a-bedd-f827837680e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab253788-17f9-4911-8eb7-7197562fc989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:39 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Volume f32f2994-606f-4987-88e9-e7f8c478fba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32f2994-606f-4987-88e9-e7f8c478fba8', 'volume_size': 1} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:39 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 1G" returned: 0 in 0.543s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:39 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 Jul 24 12:49:39 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:39 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093" returned: 0 in 0.324s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:39 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 is being set with open permissions: ugo+rw Jul 24 12:49:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:39 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 Jul 24 12:49:39 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:40 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:40 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.info Jul 24 12:49:40 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:40 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.info" returned: 0 in 0.322s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:40 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.info is being set with open permissions: ugo+rw Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:40 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.info Jul 24 12:49:40 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:40 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.info" returned: 0 in 0.285s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.375s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-180878114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32f2994-606f-4987-88e9-e7f8c478fba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da5cfd3a1b45788637cd9a69827cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:39Z,use_quota=True,user_id='f6f311d1e1a44ce6bcc55db8e6632261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Creating volume f32f2994-606f-4987-88e9-e7f8c478fba8 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:40 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:40 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8 1073741824 Jul 24 12:49:40 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:40 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-512d9eec-4e43-4dc6-a30b-3edb656b752f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Create snapshot completed successfully Jul 24 12:49:41 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8 1073741824" returned: 0 in 0.509s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:41 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8 Jul 24 12:49:41 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:41 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8" returned: 0 in 0.542s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab253788-17f9-4911-8eb7-7197562fc989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32f2994-606f-4987-88e9-e7f8c478fba8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2a815d-9e00-4b08-b03d-cb44324391c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:41 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Volume volume-f32f2994-606f-4987-88e9-e7f8c478fba8 (f32f2994-606f-4987-88e9-e7f8c478fba8): created successfully Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2a815d-9e00-4b08-b03d-cb44324391c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Flow 'volume_create_manager' (24bc3655-7383-4d7c-b550-a055bca6d88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-97aad65d-46dc-47e2-84fe-ae608cd99950 tempest-VolumesTransfersV355Test-408194256 None] Created volume successfully. Jul 24 12:49:41 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Flow 'volume_create_manager' (511080a9-1870-4827-bd86-99ef9327ea33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39802076-4c92-426d-a5a3-e9440e08dd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39802076-4c92-426d-a5a3-e9440e08dd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1362809911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6f2db8-0727-49c4-8f17-37b6b77bce4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='908d959192224251a6a1a43b86d75364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6a9ad139-f947-4d40-a4df-9cddab92eec4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:42Z,use_quota=True,user_id='a5826edd2f9743978f989464d5475c2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d694cbc-4b8a-4275-97a2-5b2c90ac4138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d694cbc-4b8a-4275-97a2-5b2c90ac4138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c421c7-74e4-4a73-910e-a6ab45a34ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c421c7-74e4-4a73-910e-a6ab45a34ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4d6f2db8-0727-49c4-8f17-37b6b77bce4d', 'volume_name': 'volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d', 'volume_size': 1, 'snapshot_id': '6a9ad139-f947-4d40-a4df-9cddab92eec4'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06410f9-04a3-424a-8c47-f6ec73f38fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f06410f9-04a3-424a-8c47-f6ec73f38fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb69950-6dc1-41fd-b3e9-143314f777f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Volume 4d6f2db8-0727-49c4-8f17-37b6b77bce4d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d', 'volume_size': 1, 'snapshot_id': '6a9ad139-f947-4d40-a4df-9cddab92eec4'} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:42 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:49:42 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Acquiring lock "cinder-quobyte-6a9ad139-f947-4d40-a4df-9cddab92eec4-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" by "_create_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (eb302c37-08a0-45b7-b002-31cbf257533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aa1dd5-84b5-4231-8eb6-f5ae4be99eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-6a9ad139-f947-4d40-a4df-9cddab92eec4-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" acquired by "_create_volume_from_snapshot" :: waited 0.087s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Creating volume 4d6f2db8-0727-49c4-8f17-37b6b77bce4d from snapshot 6a9ad139-f947-4d40-a4df-9cddab92eec4 {{(pid=88540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Acquiring lock "cinder-quobyte-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9aa1dd5-84b5-4231-8eb6-f5ae4be99eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1971171717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:42Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc93338e-2f3e-4d0e-912b-ba74976a685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc93338e-2f3e-4d0e-912b-ba74976a685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32dc473-4bb4-48e5-90ae-ad0410d864e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32dc473-4bb4-48e5-90ae-ad0410d864e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5', 'volume_name': 'volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee47bd4e-3d65-481a-966c-4d76feaf14da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee47bd4e-3d65-481a-966c-4d76feaf14da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0476d8c4-997d-4b3e-97db-e09922362270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume 38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5', 'volume_size': 1} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" acquired by "_copy_volume_from_snapshot" :: waited 0.117s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] snapshot: 6a9ad139-f947-4d40-a4df-9cddab92eec4, volume: 4d6f2db8-0727-49c4-8f17-37b6b77bce4d, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:42 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.360s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb483294-be9c-4d5c-bee5-4c76129663e9]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:42 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 Jul 24 12:49:42 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (081f485f-68f4-4f0a-b46b-d53676b9b5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6297c1-6db2-41bf-aa6a-fb399ad0d753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6297c1-6db2-41bf-aa6a-fb399ad0d753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543847516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e39861f-0318-41c4-8dad-877570ce76b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:43Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf46a168-d7a2-4faa-b952-a2cde4802a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf46a168-d7a2-4faa-b952-a2cde4802a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711cb310-08c6-4f87-920c-28dfa5257b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (711cb310-08c6-4f87-920c-28dfa5257b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e39861f-0318-41c4-8dad-877570ce76b4', 'volume_name': 'volume-0e39861f-0318-41c4-8dad-877570ce76b4', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7781758c-63ee-4bb7-8178-5ca6933996df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7781758c-63ee-4bb7-8178-5ca6933996df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8697eafe-6f00-49a9-94bf-a3ddad0bc394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:43 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume 0e39861f-0318-41c4-8dad-877570ce76b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e39861f-0318-41c4-8dad-877570ce76b4', 'volume_size': 1} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:43 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4" returned: 0 in 0.676s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f45d70-ec0f-41bf-bce9-a481672894af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[73315a48-cd43-47df-a410-e2a24603437a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:43 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af Jul 24 12:49:43 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (1e1ad7a2-06e8-49b6-b6d4-47c4530c1a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df34ed52-41e4-44e3-906a-492be53ef327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:43 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-33acec92-7590-4489-8d74-a056c3b824e7 tempest-VolumesTransfersV355Test-1112858503 None] Transfer volume completed successfully. Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df34ed52-41e4-44e3-906a-492be53ef327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4898676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0ff096-7284-489b-b25b-f8e06bb34fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:43Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7427f8b8-860f-406e-8cd6-c4ba9d7f3b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7427f8b8-860f-406e-8cd6-c4ba9d7f3b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460f6ae0-32ab-410a-a0ce-e536d73294ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460f6ae0-32ab-410a-a0ce-e536d73294ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0ff096-7284-489b-b25b-f8e06bb34fa7', 'volume_name': 'volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167b13ff-6bfd-42f0-9f18-b2d9b5695d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167b13ff-6bfd-42f0-9f18-b2d9b5695d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8cf214-1eb9-4998-8bc6-2c3e6d8f39c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:43 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume 6a0ff096-7284-489b-b25b-f8e06bb34fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7', 'volume_size': 1} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:43 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af" returned: 0 in 0.646s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:49:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:43 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d Jul 24 12:49:43 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (4a292f5f-5481-4866-996e-a5446b3cf3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabbbe16-5953-4521-935a-e2f0a3a7f616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Acquiring lock "cinder-f32f2994-606f-4987-88e9-e7f8c478fba8-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabbbe16-5953-4521-935a-e2f0a3a7f616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173322232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214b58ae-e94a-4274-9849-d5645208a323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:45Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3db430-02d5-4bdd-abf5-416e8234f0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3db430-02d5-4bdd-abf5-416e8234f0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddca5920-95cf-46b0-a7da-31d7ddd3af01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddca5920-95cf-46b0-a7da-31d7ddd3af01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '214b58ae-e94a-4274-9849-d5645208a323', 'volume_name': 'volume-214b58ae-e94a-4274-9849-d5645208a323', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09590e0f-783f-4baa-b0e1-aadad2cb36e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09590e0f-783f-4baa-b0e1-aadad2cb36e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5117ebb1-5907-4786-9b68-16bd17ed2ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:44 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume 214b58ae-e94a-4274-9849-d5645208a323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-214b58ae-e94a-4274-9849-d5645208a323', 'volume_size': 1} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Lock "cinder-f32f2994-606f-4987-88e9-e7f8c478fba8-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Acquiring lock "cinder-quobyte-f32f2994-606f-4987-88e9-e7f8c478fba8" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Lock "cinder-quobyte-f32f2994-606f-4987-88e9-e7f8c478fba8" acquired by "delete_volume" :: waited 0.052s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd9b1f5-e04f-4500-b78c-aeba1c7f3a18]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:45 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8 Jul 24 12:49:45 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (c2c47e4b-9c90-410d-9b98-5c5d84339e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4307386b-3537-4936-834c-4166999d4be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4307386b-3537-4936-834c-4166999d4be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1330805008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064f3b4a-94af-482c-8014-8cf19d569beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:46Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36047f13-89f6-440c-9e6c-7c9ff1599e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36047f13-89f6-440c-9e6c-7c9ff1599e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c57583-a851-4766-a623-2c2e0c6eb013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c57583-a851-4766-a623-2c2e0c6eb013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064f3b4a-94af-482c-8014-8cf19d569beb', 'volume_name': 'volume-064f3b4a-94af-482c-8014-8cf19d569beb', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9ee1ca-f069-4e33-88d2-32f63e2f4f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae9ee1ca-f069-4e33-88d2-32f63e2f4f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:46 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d35c9c-cd2a-4bac-a37d-7a9057e50e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:46 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume 064f3b4a-94af-482c-8014-8cf19d569beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064f3b4a-94af-482c-8014-8cf19d569beb', 'volume_size': 1} Jul 24 12:49:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:46 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8" returned: 0 in 1.295s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:46 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8 Jul 24 12:49:46 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:47 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f32f2994-606f-4987-88e9-e7f8c478fba8" returned: 0 in 0.576s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Lock "cinder-quobyte-f32f2994-606f-4987-88e9-e7f8c478fba8" released by "delete_volume" :: held 2.004s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:47 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Created reservations ['568ee348-5e7e-4572-a279-2674471a801a', '43fe5618-b136-4352-8c75-39e986cbeeb1', '5a5af531-d576-48e9-a614-73faae7b3748', '970c57dc-c63e-45a6-8cca-1afce017dd8f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:49:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:47 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:49:47 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:48 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.477s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:48 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:49:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Deleted volume successfully. Jul 24 12:49:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e36f5993-8aff-4447-98e4-bf29ae6edc36 tempest-VolumesTransfersV355Test-177654852 None] Lock "cinder-f32f2994-606f-4987-88e9-e7f8c478fba8-delete_volume" released by "delete_volume" :: held 3.408s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Flow 'volume_create_manager' (66899c5f-0bb7-4f0b-a4a7-a7f11bd8e061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3773cef-7746-4018-9a05-0225395e0337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3773cef-7746-4018-9a05-0225395e0337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-881206591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443ea78b-82b6-4d0f-8c90-d4b945b2f682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da5cfd3a1b45788637cd9a69827cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:50Z,use_quota=True,user_id='f6f311d1e1a44ce6bcc55db8e6632261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6848185b-b224-41fd-94c0-63486b1ecbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6848185b-b224-41fd-94c0-63486b1ecbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24420dd2-aa9c-4c93-b499-595b3a533d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24420dd2-aa9c-4c93-b499-595b3a533d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '443ea78b-82b6-4d0f-8c90-d4b945b2f682', 'volume_name': 'volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e092710-3503-4d69-9bca-288e0edf4ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e092710-3503-4d69-9bca-288e0edf4ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28605a02-539c-46cf-9bd2-60d0d9cc5d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:50 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Volume 443ea78b-82b6-4d0f-8c90-d4b945b2f682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682', 'volume_size': 1} Jul 24 12:49:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" returned: 0 in 7.543s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:51 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa55ea04-37d7-48e3-8e6f-1173c2581254]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:51 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af Jul 24 12:49:51 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:52 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af" returned: 0 in 0.958s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:49:52 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Converted 1024.00 MB image at 135.74 MB/s Jul 24 12:49:52 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d is being set with open permissions: ugo+rw Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:52 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d Jul 24 12:49:52 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:52 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" returned: 0 in 0.325s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" released by "_copy_volume_from_snapshot" :: held 10.387s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-6a9ad139-f947-4d40-a4df-9cddab92eec4-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" released by "_create_volume_from_snapshot" :: held 10.527s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.615s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.411s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1971171717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:42Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Creating volume 38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:52 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:52 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 1073741824 Jul 24 12:49:52 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb69950-6dc1-41fd-b3e9-143314f777f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d', 'volume_size': 1, 'snapshot_id': '6a9ad139-f947-4d40-a4df-9cddab92eec4'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85991fd-80e0-4455-91ca-a836fd206a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:52 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Volume volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d (4d6f2db8-0727-49c4-8f17-37b6b77bce4d): created successfully Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85991fd-80e0-4455-91ca-a836fd206a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Flow 'volume_create_manager' (511080a9-1870-4827-bd86-99ef9327ea33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-af4489d8-f62a-4128-8897-890683552650 tempest-TestStampPattern-914984710 None] Created volume successfully. Jul 24 12:49:53 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 1073741824" returned: 0 in 0.600s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:53 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 Jul 24 12:49:53 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:53 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5" returned: 0 in 0.304s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.800s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-543847516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e39861f-0318-41c4-8dad-877570ce76b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:43Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Creating volume 0e39861f-0318-41c4-8dad-877570ce76b4 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:53 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0476d8c4-997d-4b3e-97db-e09922362270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e43e22-5519-432e-9b2f-b1b732c423f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:53 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4 1073741824 Jul 24 12:49:53 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:53 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 (38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5): created successfully Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33e43e22-5519-432e-9b2f-b1b732c423f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (eb302c37-08a0-45b7-b002-31cbf257533c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cfcc689b-904f-459e-a8e3-2e554608087f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created volume successfully. Jul 24 12:49:54 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4 1073741824" returned: 0 in 0.682s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:54 devstack sudo[101716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4 Jul 24 12:49:54 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:55 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4" returned: 0 in 0.504s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.312s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-4898676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0ff096-7284-489b-b25b-f8e06bb34fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:43Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Creating volume 6a0ff096-7284-489b-b25b-f8e06bb34fa7 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:55 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8697eafe-6f00-49a9-94bf-a3ddad0bc394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e39861f-0318-41c4-8dad-877570ce76b4', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f34158-d715-4daa-8b94-5a079ec59223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:55 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 1073741824 Jul 24 12:49:55 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:55 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume volume-0e39861f-0318-41c4-8dad-877570ce76b4 (0e39861f-0318-41c4-8dad-877570ce76b4): created successfully Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f34158-d715-4daa-8b94-5a079ec59223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (081f485f-68f4-4f0a-b46b-d53676b9b5e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:55 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d9ef869b-d65d-4c5e-84d5-9d1161432081 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created volume successfully. Jul 24 12:49:55 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 1073741824" returned: 0 in 0.801s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:56 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 Jul 24 12:49:56 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:56 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7" returned: 0 in 0.290s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.452s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1173322232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214b58ae-e94a-4274-9849-d5645208a323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:45Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Creating volume 214b58ae-e94a-4274-9849-d5645208a323 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:56 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c8cf214-1eb9-4998-8bc6-2c3e6d8f39c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bcaa10-ede0-4775-9d0e-0e9e7f1b085d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:56 devstack sudo[101773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323 1073741824 Jul 24 12:49:56 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:56 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 (6a0ff096-7284-489b-b25b-f8e06bb34fa7): created successfully Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bcaa10-ede0-4775-9d0e-0e9e7f1b085d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (1e1ad7a2-06e8-49b6-b6d4-47c4530c1a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3065f650-94be-41c6-a243-b7de8578d186 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created volume successfully. Jul 24 12:49:56 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323 1073741824" returned: 0 in 0.606s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:57 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323 Jul 24 12:49:57 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:57 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323" returned: 0 in 0.332s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.236s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1330805008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064f3b4a-94af-482c-8014-8cf19d569beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='080c4baec882449a954a2539a0809d58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:46Z,use_quota=True,user_id='22039290991d45cf89ef5c4c23f90ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Creating volume 064f3b4a-94af-482c-8014-8cf19d569beb {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:57 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5117ebb1-5907-4786-9b68-16bd17ed2ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-214b58ae-e94a-4274-9849-d5645208a323', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:57 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb 1073741824 Jul 24 12:49:57 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9951e18-1dff-4fd3-81df-05a315f5ca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:57 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume volume-214b58ae-e94a-4274-9849-d5645208a323 (214b58ae-e94a-4274-9849-d5645208a323): created successfully Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9951e18-1dff-4fd3-81df-05a315f5ca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:57 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (4a292f5f-5481-4866-996e-a5446b3cf3b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:57 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d5549ea4-1ea8-441e-8f0c-c583258d481f tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created volume successfully. Jul 24 12:49:58 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb 1073741824" returned: 0 in 0.773s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:58 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb Jul 24 12:49:58 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:58 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb" returned: 0 in 0.391s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.684s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:49:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-881206591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=443ea78b-82b6-4d0f-8c90-d4b945b2f682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1da5cfd3a1b45788637cd9a69827cdd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:49:50Z,use_quota=True,user_id='f6f311d1e1a44ce6bcc55db8e6632261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Creating volume 443ea78b-82b6-4d0f-8c90-d4b945b2f682 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:49:58 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2d35c9c-cd2a-4bac-a37d-7a9057e50e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064f3b4a-94af-482c-8014-8cf19d569beb', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:58 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 1073741824 Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56080ab4-8245-428a-8a52-476363b0f4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:58 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:58 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Volume volume-064f3b4a-94af-482c-8014-8cf19d569beb (064f3b4a-94af-482c-8014-8cf19d569beb): created successfully Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56080ab4-8245-428a-8a52-476363b0f4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Flow 'volume_create_manager' (c2c47e4b-9c90-410d-9b98-5c5d84339e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:58 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-165953b2-62e8-4c2b-93b3-e3bbfdfb6fa2 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created volume successfully. Jul 24 12:49:59 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 1073741824" returned: 0 in 0.691s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:59 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 Jul 24 12:49:59 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-064f3b4a-94af-482c-8014-8cf19d569beb-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-064f3b4a-94af-482c-8014-8cf19d569beb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:59 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682" returned: 0 in 0.408s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28605a02-539c-46cf-9bd2-60d0d9cc5d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc28bfb7-39ab-49a5-bbb3-0a28bc4df402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:49:59 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Volume volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 (443ea78b-82b6-4d0f-8c90-d4b945b2f682): created successfully Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc28bfb7-39ab-49a5-bbb3-0a28bc4df402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Flow 'volume_create_manager' (66899c5f-0bb7-4f0b-a4a7-a7f11bd8e061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-quobyte-064f3b4a-94af-482c-8014-8cf19d569beb" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:49:59 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-15757f0d-3a3a-409a-a5c6-5c9f0bec662b tempest-VolumesTransfersV355Test-408194256 None] Created volume successfully. Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-064f3b4a-94af-482c-8014-8cf19d569beb" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9955060f-dbd2-4225-9f1b-361faf011715]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:49:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:49:59 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb Jul 24 12:49:59 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:00 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb" returned: 0 in 0.388s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:00 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb Jul 24 12:50:00 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:00 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-064f3b4a-94af-482c-8014-8cf19d569beb" returned: 0 in 0.514s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-064f3b4a-94af-482c-8014-8cf19d569beb" released by "delete_volume" :: held 0.979s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Acquiring lock "cinder-443ea78b-82b6-4d0f-8c90-d4b945b2f682-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Lock "cinder-443ea78b-82b6-4d0f-8c90-d4b945b2f682-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Acquiring lock "cinder-quobyte-443ea78b-82b6-4d0f-8c90-d4b945b2f682" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created reservations ['791c470f-7391-4660-a4ef-29374d5a33b0', 'e0f98292-a1fc-4d07-b32f-8cf359d26f21', '0ee1c551-93ae-4e40-a0ce-cae8db303985', 'bc57746a-6a98-47b5-a435-bb694d097ecb'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Lock "cinder-quobyte-443ea78b-82b6-4d0f-8c90-d4b945b2f682" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bef9317-5605-4e1e-8e99-bebb271c7583]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:01 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:01 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:01 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 Jul 24 12:50:01 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:01 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682" returned: 0 in 0.613s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:01 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.570s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:01 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682 Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:01 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:01 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Deleted volume successfully. Jul 24 12:50:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c9e57229-087a-4e39-b68e-b1923115b51b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-064f3b4a-94af-482c-8014-8cf19d569beb-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-214b58ae-e94a-4274-9849-d5645208a323-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-214b58ae-e94a-4274-9849-d5645208a323-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:02 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-443ea78b-82b6-4d0f-8c90-d4b945b2f682" returned: 0 in 0.531s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-quobyte-214b58ae-e94a-4274-9849-d5645208a323" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Lock "cinder-quobyte-443ea78b-82b6-4d0f-8c90-d4b945b2f682" released by "delete_volume" :: held 1.224s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-214b58ae-e94a-4274-9849-d5645208a323" acquired by "delete_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1f1d3a-5436-4853-a22f-90f2316e79c7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Created reservations ['1465f15a-0c5b-4290-9e1e-01df7eff0e6a', '4e99f6cc-b528-4421-b871-fe247a5c0484', '6e6f1346-bd51-4500-a307-a13454a2bb3c', '48fc4142-9864-43c4-ae5e-33e52e426060'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:02 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323 Jul 24 12:50:02 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:02 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:02 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:02 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323" returned: 0 in 0.615s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:03 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.492s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:03 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323 Jul 24 12:50:03 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Deleted volume successfully. Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4cf6c9f5-4b71-4479-90d1-4f9007b1d67a tempest-VolumesTransfersV355Test-177654852 None] Lock "cinder-443ea78b-82b6-4d0f-8c90-d4b945b2f682-delete_volume" released by "delete_volume" :: held 2.135s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:03 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-214b58ae-e94a-4274-9849-d5645208a323" returned: 0 in 0.622s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-214b58ae-e94a-4274-9849-d5645208a323" released by "delete_volume" :: held 1.310s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created reservations ['7c35a605-d0d3-4cde-a1bb-d52af9543f14', 'c14f38ee-f146-4b1d-b493-1f0c2e6f98b5', 'ac06895b-c673-4b92-9463-5f62330e3a02', '77a72bee-6a9a-409a-99fc-c6b5968b633e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:03 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:03 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:04 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.357s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:04 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:04 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Deleted volume successfully. Jul 24 12:50:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4559101a-a9e7-40f2-a8f0-0fe40497d8dc tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-214b58ae-e94a-4274-9849-d5645208a323-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-6a0ff096-7284-489b-b25b-f8e06bb34fa7-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-6a0ff096-7284-489b-b25b-f8e06bb34fa7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-quobyte-6a0ff096-7284-489b-b25b-f8e06bb34fa7" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-6a0ff096-7284-489b-b25b-f8e06bb34fa7" acquired by "delete_volume" :: waited 0.027s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:04 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[52db2d69-612e-4560-a248-48fcd0e543ae]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:05 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 Jul 24 12:50:05 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:05 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7" returned: 0 in 0.519s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:05 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7 Jul 24 12:50:05 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:05 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6a0ff096-7284-489b-b25b-f8e06bb34fa7" returned: 0 in 0.503s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-6a0ff096-7284-489b-b25b-f8e06bb34fa7" released by "delete_volume" :: held 1.082s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:05 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created reservations ['78ec2a6b-a090-4f8d-87de-2f5b88c1e0e0', 'c1bbc0dc-9052-4c0d-83bf-c55fbdaf6aed', 'b71d20d0-281b-489f-b3ca-cc7e19bbfb15', '293d0395-3795-4a0e-b4f1-7186caad131c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:06 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:06 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:06 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.420s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:06 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Deleted volume successfully. Jul 24 12:50:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b3366480-2486-4515-889c-a18198f404ac tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-6a0ff096-7284-489b-b25b-f8e06bb34fa7-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-0e39861f-0318-41c4-8dad-877570ce76b4-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-0e39861f-0318-41c4-8dad-877570ce76b4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-quobyte-0e39861f-0318-41c4-8dad-877570ce76b4" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-0e39861f-0318-41c4-8dad-877570ce76b4" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:07 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4206dec9-8881-4dae-9c30-a9e4561e9e6f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:07 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4 Jul 24 12:50:07 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:07 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4" returned: 0 in 0.582s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:07 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4 Jul 24 12:50:07 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:08 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e39861f-0318-41c4-8dad-877570ce76b4" returned: 0 in 0.329s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-0e39861f-0318-41c4-8dad-877570ce76b4" released by "delete_volume" :: held 0.977s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=143,cinder:SELECT=123,cinder:DELETE=15,cinder:INSERT=36 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created reservations ['271f2eb9-20e3-4a83-a051-85acd5cc2429', '09765c3d-06a8-4ec1-a09e-be24ca199d5d', '1d1e7213-03ee-4032-a3f7-c2cd0eb5121e', '4b76aea3-5252-4f54-95d2-2d4ad16202cc'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:08 devstack sudo[101874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:08 devstack sudo[101874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:08 devstack sudo[101874]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.429s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Deleted volume successfully. Jul 24 12:50:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed50a4d3-d5b7-4881-abd6-947fc8c7250c tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-0e39861f-0318-41c4-8dad-877570ce76b4-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:09 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=156,cinder:INSERT=34,cinder:DELETE=12,cinder:SELECT=129 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:50:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-quobyte-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c92f8ff-60f7-4b91-b97d-7f443a0024d0]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:09 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 Jul 24 12:50:09 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:10 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5" returned: 0 in 0.598s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:10 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5 Jul 24 12:50:10 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:10 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5" returned: 0 in 0.275s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5" released by "delete_volume" :: held 0.944s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created reservations ['b6c570d2-0b69-4dea-b53d-afa6dbb19ffb', 'c463dc97-232d-4db0-944d-66178f72c2c1', '1ed7c02a-9145-44c5-b82a-0f2033ba2468', 'c2f1da5a-3f58-474e-abec-bf7a4fd89fd0'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:10 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:10 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-8df26082-631e-4c84-bd60-53b1f1709093-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-8df26082-631e-4c84-bd60-53b1f1709093-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-quobyte-9f9bdc26-51e0-46e8-874d-4b7e35158e66" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-9f9bdc26-51e0-46e8-874d-4b7e35158e66" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-quobyte-8df26082-631e-4c84-bd60-53b1f1709093" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-8df26082-631e-4c84-bd60-53b1f1709093" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Deleting offline snapshot 8df26082-631e-4c84-bd60-53b1f1709093 of volume 9f9bdc26-51e0-46e8-874d-4b7e35158e66 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] snapshot_file for this snap is: volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c51308-85e1-4d3b-9d76-77762b72811f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:10 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 Jul 24 12:50:10 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:10 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.370s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:11 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Deleted volume successfully. Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7734c680-29e2-4114-9b5c-73fced428e19 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-38beb7ae-6df3-4ffe-a12f-a3fdbc6947a5-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:11 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093" returned: 0 in 0.550s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b9855e-ac47-45fa-aa0f-a909d9ae7d67]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:11 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 Jul 24 12:50:11 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Flow 'volume_create_manager' (aea9f66f-8271-4606-8524-8bd5d946fcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c43708-593a-4ba0-80b2-6322464ae151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c43708-593a-4ba0-80b2-6322464ae151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1459338708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7144d3b-1a9a-4b75-b230-8641942c3be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9e20681f774414aef3ad3e4b0bd134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:12Z,use_quota=True,user_id='73c158db44da4928a19a11a77e0578b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d62322-41b0-43a1-b74d-6aa537b7d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d62322-41b0-43a1-b74d-6aa537b7d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4e3fb0-ec90-4f1d-bd8d-1b003c1e6433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG cinder.image.glance [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Creating Keystone auth plugin from conf {{(pid=88540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 12:50:11 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66" returned: 0 in 0.442s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:11 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 Jul 24 12:50:11 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4e3fb0-ec90-4f1d-bd8d-1b003c1e6433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7144d3b-1a9a-4b75-b230-8641942c3be7', 'volume_name': 'volume-f7144d3b-1a9a-4b75-b230-8641942c3be7', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74944ca0-d827-4ab5-bd35-70f485211fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74944ca0-d827-4ab5-bd35-70f485211fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0afa1dd-2b75-4b63-ab8e-bc7d206aa1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:12 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Volume f7144d3b-1a9a-4b75-b230-8641942c3be7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7144d3b-1a9a-4b75-b230-8641942c3be7', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Trying to clone f7144d3b-1a9a-4b75-b230-8641942c3be7 from image b9bc6022-042c-4b2c-a61d-587b72521a75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]). {{(pid=88540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 12:50:12 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093" returned: 0 in 0.413s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:12 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093 Jul 24 12:50:12 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 12:50:12 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Image download 20.69 MB at 20.69 MB/s Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e353f89-9446-4158-b1c4-f5de461729af]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:12 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Flow 'volume_create_manager' (c5631859-fe96-4ce0-aa2d-b29a331772d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db55da4d-f512-4e9f-8a2b-b29835a0b830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66.8df26082-631e-4c84-bd60-53b1f1709093" returned: 0 in 0.417s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:12 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD Jul 24 12:50:12 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db55da4d-f512-4e9f-8a2b-b29835a0b830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1415786603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533bed3b71648f8ad11259b29a8ec43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:13Z,use_quota=True,user_id='37e8740fd31f47edb791c4aeeab209af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d04271-372a-4786-b8c6-3b314556b92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d04271-372a-4786-b8c6-3b314556b92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106bcb6d-ebbb-4056-9565-de2726087b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (106bcb6d-ebbb-4056-9565-de2726087b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8', 'volume_name': 'volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed3d4fa-a5df-4a61-99b6-6cedb4116bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed3d4fa-a5df-4a61-99b6-6cedb4116bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e4bb27-a8e1-4a1c-bd8b-5c5f7ddce075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:12 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Volume b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8', 'volume_size': 1} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1415786603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533bed3b71648f8ad11259b29a8ec43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:13Z,use_quota=True,user_id='37e8740fd31f47edb791c4aeeab209af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Creating volume b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:50:12 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:12 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 1073741824 Jul 24 12:50:12 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-8df26082-631e-4c84-bd60-53b1f1709093" released by "_delete_snapshot" :: held 2.078s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-9f9bdc26-51e0-46e8-874d-4b7e35158e66" released by "delete_snapshot" :: held 2.117s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:12 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created reservations ['8408639f-426b-4e45-98c3-4737697b7f5e', 'd5216021-e898-4cff-b0b6-4006d1c2addf', 'e998d383-867b-4916-8d10-5c43f0cf314c', '69320c39-b587-453c-a6df-fdd5d8cf3ef7'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Flow 'volume_create_manager' (ee51e87a-e4ec-4db7-a277-eea4fa1ee655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a59892-0b34-41bb-ad4a-02e9b155701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:13 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64a59892-0b34-41bb-ad4a-02e9b155701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1310405326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a123ac-05e2-4334-ba27-a17676540d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533bed3b71648f8ad11259b29a8ec43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:13Z,use_quota=True,user_id='37e8740fd31f47edb791c4aeeab209af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fbf132-555e-4dd2-b6cf-c201a240c03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8fbf132-555e-4dd2-b6cf-c201a240c03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6382a1b-2f9a-45b5-a0a7-400f0bdd0460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6382a1b-2f9a-45b5-a0a7-400f0bdd0460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78a123ac-05e2-4334-ba27-a17676540d8c', 'volume_name': 'volume-78a123ac-05e2-4334-ba27-a17676540d8c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f97d94-b754-4aa1-bfbf-7b4b9761e999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f97d94-b754-4aa1-bfbf-7b4b9761e999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12879b19-81cc-4550-bda0-85b68c0a4c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:13 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Volume 78a123ac-05e2-4334-ba27-a17676540d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78a123ac-05e2-4334-ba27-a17676540d8c', 'volume_size': 1} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD" returned: 0 in 0.589s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Temporary image b9bc6022-042c-4b2c-a61d-587b72521a75 is fetched for user 73c158db44da4928a19a11a77e0578b8. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 12:50:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Delete snapshot completed successfully. Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7f81456e-de3f-4144-bf38-6552e5a01ea6 tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-8df26082-631e-4c84-bd60-53b1f1709093-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b716d1bd-23f3-49c6-ac7a-a842290f21cc]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:13 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD Jul 24 12:50:13 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:13 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 1073741824" returned: 0 in 0.556s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:13 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 Jul 24 12:50:13 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:13 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:13 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8" returned: 0 in 0.267s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1310405326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78a123ac-05e2-4334-ba27-a17676540d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9533bed3b71648f8ad11259b29a8ec43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:13Z,use_quota=True,user_id='37e8740fd31f47edb791c4aeeab209af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Creating volume 78a123ac-05e2-4334-ba27-a17676540d8c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:50:13 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e4bb27-a8e1-4a1c-bd8b-5c5f7ddce075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:13 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c 1073741824 Jul 24 12:50:13 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9db6aa9-5988-40c9-8016-096131e8b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:13 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Volume volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 (b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8): created successfully Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9db6aa9-5988-40c9-8016-096131e8b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Flow 'volume_create_manager' (c5631859-fe96-4ce0-aa2d-b29a331772d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-74b1bab5-6a0d-44d1-aa7d-61f625cebec7 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Created volume successfully. Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-9f9bdc26-51e0-46e8-874d-4b7e35158e66-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-9f9bdc26-51e0-46e8-874d-4b7e35158e66-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "cinder-quobyte-9f9bdc26-51e0-46e8-874d-4b7e35158e66" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-9f9bdc26-51e0-46e8-874d-4b7e35158e66" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7b0dc9-6485-44e9-8589-dc84ce641c1e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:14 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 Jul 24 12:50:14 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:14 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c 1073741824" returned: 0 in 0.538s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:14 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c Jul 24 12:50:14 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:14 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66" returned: 0 in 0.384s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:14 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66 Jul 24 12:50:14 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:14 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c" returned: 0 in 0.260s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1459338708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7144d3b-1a9a-4b75-b230-8641942c3be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9e20681f774414aef3ad3e4b0bd134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:12Z,use_quota=True,user_id='73c158db44da4928a19a11a77e0578b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Creating volume f7144d3b-1a9a-4b75-b230-8641942c3be7 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:50:14 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:14 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 1073741824 Jul 24 12:50:14 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12879b19-81cc-4550-bda0-85b68c0a4c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78a123ac-05e2-4334-ba27-a17676540d8c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4929513-418d-4fb0-97b1-0f68e7dd8494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:14 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Volume volume-78a123ac-05e2-4334-ba27-a17676540d8c (78a123ac-05e2-4334-ba27-a17676540d8c): created successfully Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4929513-418d-4fb0-97b1-0f68e7dd8494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Flow 'volume_create_manager' (ee51e87a-e4ec-4db7-a277-eea4fa1ee655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8f840b13-2e70-4603-927b-8a3f6e55471a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Created volume successfully. Jul 24 12:50:14 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f9bdc26-51e0-46e8-874d-4b7e35158e66" returned: 0 in 0.321s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-quobyte-9f9bdc26-51e0-46e8-874d-4b7e35158e66" released by "delete_volume" :: held 0.779s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Created reservations ['cfe47b87-1948-45ea-addd-b3d13e999017', '826b9a41-945b-47ee-bca7-e73692d8b681', 'b9769e18-6cc0-47ed-980d-92e655c9e135', '0464d9fb-aa4b-4f29-97a3-90c88729d8fc'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:14 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:14 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:15 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 1073741824" returned: 0 in 0.573s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:15 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 Jul 24 12:50:15 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:15 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.327s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Deleted volume successfully. Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fb2065a6-a561-4656-8d1c-756c5002746b tempest-CreateVolumesFromSnapshotTest-1695978021 None] Lock "cinder-9f9bdc26-51e0-46e8-874d-4b7e35158e66-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:15 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7" returned: 0 in 0.311s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Attempting download of b9bc6022-042c-4b2c-a61d-587b72521a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}])) to volume f7144d3b-1a9a-4b75-b230-8641942c3be7. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79b994c-7cab-41aa-a53c-00fe3d5587b2]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_qzmd80fu {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:15 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_qzmd80fu Jul 24 12:50:15 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:15 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_qzmd80fu" returned: 0 in 0.352s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_qzmd80fu {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:16 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_qzmd80fu Jul 24 12:50:16 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:16 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_qzmd80fu" returned: 1 in 0.369s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_qzmd80fu' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:50:16 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a023a991-7ee8-4836-ba4c-d1ab20009372]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:16 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD Jul 24 12:50:16 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:16 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:16 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] b9bc6022-042c-4b2c-a61d-587b72521a75 was qcow2, converting to qcow2 {{(pid=88540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 12:50:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:16 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 Jul 24 12:50:16 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Flow 'volume_create_manager' (b42d85fb-cf96-4b20-82a7-9e2338a51be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ba7458-3ade-4734-b96d-b5f8a344a10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ba7458-3ade-4734-b96d-b5f8a344a10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1240365052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f47e29-3f42-40d4-9787-ad65b5dd5819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ae7168edb476d9d10c5ac95425900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:19Z,use_quota=True,user_id='1a45cf03c61846dabe6fd8c42eb2ca25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fde6589-c7b3-460a-93b3-c1a82164f9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fde6589-c7b3-460a-93b3-c1a82164f9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177245a1-48f6-402c-8ef4-e09eeb20f88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177245a1-48f6-402c-8ef4-e09eeb20f88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97f47e29-3f42-40d4-9787-ad65b5dd5819', 'volume_name': 'volume-97f47e29-3f42-40d4-9787-ad65b5dd5819', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25052fcc-a8d0-4f74-968f-c920e61bbc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25052fcc-a8d0-4f74-968f-c920e61bbc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1210687b-877f-4923-b165-3a28a7c2d9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:18 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Volume 97f47e29-3f42-40d4-9787-ad65b5dd5819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97f47e29-3f42-40d4-9787-ad65b5dd5819', 'volume_size': 1} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1240365052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97f47e29-3f42-40d4-9787-ad65b5dd5819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ae7168edb476d9d10c5ac95425900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:19Z,use_quota=True,user_id='1a45cf03c61846dabe6fd8c42eb2ca25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Creating volume 97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:50:18 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:18 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 1073741824 Jul 24 12:50:18 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:18 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7" returned: 0 in 2.251s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_1nguxatndevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:50:18 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Converted 112.00 MB image at 49.71 MB/s Jul 24 12:50:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:18 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 1G Jul 24 12:50:18 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:19 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 1073741824" returned: 0 in 0.462s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:19 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 1G" returned: 0 in 0.358s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Downloaded image b9bc6022-042c-4b2c-a61d-587b72521a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}])) to volume f7144d3b-1a9a-4b75-b230-8641942c3be7 successfully. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Temporary image b9bc6022-042c-4b2c-a61d-587b72521a75 for user 73c158db44da4928a19a11a77e0578b8 is deleted. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Marking volume f7144d3b-1a9a-4b75-b230-8641942c3be7 as bootable. {{(pid=88540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 12:50:19 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 Jul 24 12:50:19 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Copying metadata from image b9bc6022-042c-4b2c-a61d-587b72521a75 to f7144d3b-1a9a-4b75-b230-8641942c3be7. {{(pid=88540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Creating volume glance metadata for volume f7144d3b-1a9a-4b75-b230-8641942c3be7 backed by image b9bc6022-042c-4b2c-a61d-587b72521a75 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0afa1dd-2b75-4b63-ab8e-bc7d206aa1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7144d3b-1a9a-4b75-b230-8641942c3be7', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d980f38f-1363-4595-a257-acdbd9741e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Volume volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 (f7144d3b-1a9a-4b75-b230-8641942c3be7): created successfully Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d980f38f-1363-4595-a257-acdbd9741e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Flow 'volume_create_manager' (aea9f66f-8271-4606-8524-8bd5d946fcee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-dab57c53-6548-49fb-8585-78c4e13b0567 tempest-VolumesExtendTest-626150839 None] Created volume successfully. Jul 24 12:50:19 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819" returned: 0 in 0.293s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1210687b-877f-4923-b165-3a28a7c2d9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97f47e29-3f42-40d4-9787-ad65b5dd5819', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d8d447-efc7-443f-8408-38dc35002756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Volume volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 (97f47e29-3f42-40d4-9787-ad65b5dd5819): created successfully Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d8d447-efc7-443f-8408-38dc35002756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Flow 'volume_create_manager' (b42d85fb-cf96-4b20-82a7-9e2338a51be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4689cd18-57ed-4dd5-b72e-cb2f53c9e8b7 tempest-VolumeDependencyTests-196036776 None] Created volume successfully. Jul 24 12:50:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ca5da1b0-047f-411c-9cff-6045f7464e23 tempest-VolumesExtendTest-626150839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ca5da1b0-047f-411c-9cff-6045f7464e23 tempest-VolumesExtendTest-626150839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:20 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1d3a9d-f740-4d2b-85db-13b837bfb0df]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ca5da1b0-047f-411c-9cff-6045f7464e23 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:20 devstack sudo[102083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 Jul 24 12:50:20 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:21 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ca5da1b0-047f-411c-9cff-6045f7464e23 tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7" returned: 0 in 0.816s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ca5da1b0-047f-411c-9cff-6045f7464e23 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 2G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ca5da1b0-047f-411c-9cff-6045f7464e23 tempest-VolumesExtendTest-626150839 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 2G" returned: 0 in 0.152s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ca5da1b0-047f-411c-9cff-6045f7464e23 tempest-VolumesExtendTest-626150839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.019s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.286s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Creating offline snapshot 20c35ecd-8b47-4503-81d8-0ba995139c9b of volume 97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:50:21 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ded67a-ee4f-449f-ba71-1ad3cd55ef69]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ca5da1b0-047f-411c-9cff-6045f7464e23 tempest-VolumesExtendTest-626150839 None] Extend volume completed successfully. Jul 24 12:50:21 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 Jul 24 12:50:21 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:22 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819" returned: 0 in 0.424s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:22 devstack sudo[102141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b 1G Jul 24 12:50:22 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:22 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b 1G" returned: 0 in 0.472s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:22 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b Jul 24 12:50:22 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:23 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b" returned: 0 in 0.606s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:23 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b is being set with open permissions: ugo+rw Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:23 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Acquiring lock "cinder-f7144d3b-1a9a-4b75-b230-8641942c3be7-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:23 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Lock "cinder-f7144d3b-1a9a-4b75-b230-8641942c3be7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Acquiring lock "cinder-quobyte-f7144d3b-1a9a-4b75-b230-8641942c3be7" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Lock "cinder-quobyte-f7144d3b-1a9a-4b75-b230-8641942c3be7" acquired by "delete_volume" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c23c68-8cc9-4be4-9312-ae9311ae3faf]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:23 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 Jul 24 12:50:23 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:23 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b" returned: 0 in 0.473s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:23 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.info Jul 24 12:50:23 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:23 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7" returned: 0 in 0.511s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:23 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7 Jul 24 12:50:23 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:24 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.info" returned: 0 in 0.345s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:24 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.info is being set with open permissions: ugo+rw Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:24 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.info Jul 24 12:50:24 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:24 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f7144d3b-1a9a-4b75-b230-8641942c3be7" returned: 0 in 0.302s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Lock "cinder-quobyte-f7144d3b-1a9a-4b75-b230-8641942c3be7" released by "delete_volume" :: held 0.927s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Created reservations ['a72f8eec-24b7-47c6-a6b2-c6a972c8c06b', '99bb0bd7-9910-4f72-bf70-299c855c977a', '8aa37b7b-310e-453a-af97-eea07493129d', 'ff5bd16f-45d0-4103-b29e-a6f74e30498e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:24 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.info" returned: 0 in 0.335s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8fae15f1-80fe-4fa4-81c1-014f13ea4d17 tempest-VolumeDependencyTests-196036776 None] Create snapshot completed successfully Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:24 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:24 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:24 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.337s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Deleted volume successfully. Jul 24 12:50:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ebc5670-186f-4706-92ab-0021560ca252 tempest-VolumesExtendTest-626150839 None] Lock "cinder-f7144d3b-1a9a-4b75-b230-8641942c3be7-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-0ad0189d-00e3-43e9-8644-17851717bf2d req-3db73a7e-ebb9-4e1c-b190-93c91a1454ed tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-0ad0189d-00e3-43e9-8644-17851717bf2d req-3db73a7e-ebb9-4e1c-b190-93c91a1454ed tempest-TestStampPattern-914984710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Flow 'volume_create_manager' (e7757eea-dd89-4f11-b6d8-8a6af8d80019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccde77e3-a535-4156-bb17-24af514f6e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6846b5c6-bdc5-4b2c-ad30-30dd25eb9f22]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-0ad0189d-00e3-43e9-8644-17851717bf2d req-3db73a7e-ebb9-4e1c-b190-93c91a1454ed tempest-TestStampPattern-914984710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccde77e3-a535-4156-bb17-24af514f6e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1527072335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe5b059-d06d-4cd5-926a-1f145bf42f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9e20681f774414aef3ad3e4b0bd134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:27Z,use_quota=True,user_id='73c158db44da4928a19a11a77e0578b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561ea384-53e2-49dc-b6e8-547dbb8eb96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561ea384-53e2-49dc-b6e8-547dbb8eb96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3c341a-d503-4888-bd85-002df50be8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3c341a-d503-4888-bd85-002df50be8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe5b059-d06d-4cd5-926a-1f145bf42f51', 'volume_name': 'volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc01c76-3e7d-434b-9029-4021cc7ae4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc01c76-3e7d-434b-9029-4021cc7ae4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db29e61-229a-4faa-b6e1-86cb394f941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Volume 0fe5b059-d06d-4cd5-926a-1f145bf42f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51', 'volume_size': 1} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Flow 'volume_create_manager' (4d340ce0-da55-4726-9294-c5ed874c3b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb29243b-a513-4894-942b-f0c88b34c1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack sudo[102192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d Jul 24 12:50:26 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb29243b-a513-4894-942b-f0c88b34c1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-74685649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93b9043-3c73-43ae-8bd6-b66380afd64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ae7168edb476d9d10c5ac95425900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=20c35ecd-8b47-4503-81d8-0ba995139c9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:27Z,use_quota=True,user_id='1a45cf03c61846dabe6fd8c42eb2ca25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3431ee72-7c3f-4ef8-8a50-8c02494ba36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3431ee72-7c3f-4ef8-8a50-8c02494ba36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7becb2-379d-40e1-9cba-81893e09a9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a7becb2-379d-40e1-9cba-81893e09a9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c93b9043-3c73-43ae-8bd6-b66380afd64b', 'volume_name': 'volume-c93b9043-3c73-43ae-8bd6-b66380afd64b', 'volume_size': 1, 'snapshot_id': '20c35ecd-8b47-4503-81d8-0ba995139c9b'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c866ad3c-3e93-4b89-ad50-c5a291b2fef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c866ad3c-3e93-4b89-ad50-c5a291b2fef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b916969-2743-4cf5-8e09-2cbf96fee5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:26 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Volume c93b9043-3c73-43ae-8bd6-b66380afd64b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c93b9043-3c73-43ae-8bd6-b66380afd64b', 'volume_size': 1, 'snapshot_id': '20c35ecd-8b47-4503-81d8-0ba995139c9b'} Jul 24 12:50:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:27 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-0ad0189d-00e3-43e9-8644-17851717bf2d req-3db73a7e-ebb9-4e1c-b190-93c91a1454ed tempest-TestStampPattern-914984710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" returned: 0 in 0.390s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-0ad0189d-00e3-43e9-8644-17851717bf2d req-3db73a7e-ebb9-4e1c-b190-93c91a1454ed tempest-TestStampPattern-914984710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.452s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1527072335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe5b059-d06d-4cd5-926a-1f145bf42f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed9e20681f774414aef3ad3e4b0bd134',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:27Z,use_quota=True,user_id='73c158db44da4928a19a11a77e0578b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Creating volume 0fe5b059-d06d-4cd5-926a-1f145bf42f51 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:50:27 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:27 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 1073741824 Jul 24 12:50:27 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-0ad0189d-00e3-43e9-8644-17851717bf2d req-3db73a7e-ebb9-4e1c-b190-93c91a1454ed tempest-TestStampPattern-914984710 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8efc7e0-7fb7-4da2-8b9c-482844185671', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:50:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-0ad0189d-00e3-43e9-8644-17851717bf2d req-3db73a7e-ebb9-4e1c-b190-93c91a1454ed tempest-TestStampPattern-914984710 None] attachment_update completed successfully. Jul 24 12:50:27 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 1073741824" returned: 0 in 0.488s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:27 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 Jul 24 12:50:27 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:28 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51" returned: 0 in 0.296s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.064s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "cinder-quobyte-20c35ecd-8b47-4503-81d8-0ba995139c9b-c93b9043-3c73-43ae-8bd6-b66380afd64b" by "_create_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db29e61-229a-4faa-b6e1-86cb394f941d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c56351f-1717-438f-8545-492bf4d87c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-20c35ecd-8b47-4503-81d8-0ba995139c9b-c93b9043-3c73-43ae-8bd6-b66380afd64b" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Creating volume c93b9043-3c73-43ae-8bd6-b66380afd64b from snapshot 20c35ecd-8b47-4503-81d8-0ba995139c9b {{(pid=88540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "cinder-quobyte-c93b9043-3c73-43ae-8bd6-b66380afd64b" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:28 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Volume volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 (0fe5b059-d06d-4cd5-926a-1f145bf42f51): created successfully Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c56351f-1717-438f-8545-492bf4d87c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Flow 'volume_create_manager' (e7757eea-dd89-4f11-b6d8-8a6af8d80019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-c93b9043-3c73-43ae-8bd6-b66380afd64b" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] snapshot: 20c35ecd-8b47-4503-81d8-0ba995139c9b, volume: c93b9043-3c73-43ae-8bd6-b66380afd64b, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:50:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e138e520-57e2-4369-af7f-1850050edbb4 tempest-VolumesExtendTest-626150839 None] Created volume successfully. Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[75908ee6-016e-4a3d-bd27-2a3d14aaa0be]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:28 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b Jul 24 12:50:28 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:28 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b" returned: 0 in 0.539s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97f47e29-3f42-40d4-9787-ad65b5dd5819(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9909411-82ad-44f8-bcda-73577c9ce949]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:28 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 Jul 24 12:50:28 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:29 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819" returned: 0 in 0.368s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:29 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:50:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:29 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b Jul 24 12:50:29 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:33 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-4f7916c8-a667-4715-9907-23a329d871f2 req-a316aa09-19cc-41c3-9048-c2952df0d205 tempest-TestStampPattern-914984710 None] Terminate volume connection completed successfully. Jul 24 12:50:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-4f7916c8-a667-4715-9907-23a329d871f2 req-a316aa09-19cc-41c3-9048-c2952df0d205 tempest-TestStampPattern-914984710 None] Deleting attachment e8efc7e0-7fb7-4da2-8b9c-482844185671. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:50:35 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b" returned: 0 in 6.277s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:35 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5927d3fe-01c2-43a4-814e-ffef8cac6ab0]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:35 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 Jul 24 12:50:35 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:36 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819" returned: 0 in 0.696s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:50:36 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Converted 1024.00 MB image at 163.09 MB/s Jul 24 12:50:36 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b is being set with open permissions: ugo+rw Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:36 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b Jul 24 12:50:36 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:36 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b" returned: 0 in 0.289s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-c93b9043-3c73-43ae-8bd6-b66380afd64b" released by "_copy_volume_from_snapshot" :: held 8.301s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-20c35ecd-8b47-4503-81d8-0ba995139c9b-c93b9043-3c73-43ae-8bd6-b66380afd64b" released by "_create_volume_from_snapshot" :: held 8.361s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.409s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.507s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Creating offline snapshot ab293f1d-720b-411c-813b-29ade9c91b91 of volume 0fe5b059-d06d-4cd5-926a-1f145bf42f51 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b916969-2743-4cf5-8e09-2cbf96fee5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93b9043-3c73-43ae-8bd6-b66380afd64b', 'volume_size': 1, 'snapshot_id': '20c35ecd-8b47-4503-81d8-0ba995139c9b'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff28cc9e-fc84-436a-9c75-e3c7994b285d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[87de30bd-81d5-4bfd-96db-e8f71740c344]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:36 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Volume volume-c93b9043-3c73-43ae-8bd6-b66380afd64b (c93b9043-3c73-43ae-8bd6-b66380afd64b): created successfully Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff28cc9e-fc84-436a-9c75-e3c7994b285d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Flow 'volume_create_manager' (4d340ce0-da55-4726-9294-c5ed874c3b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-efcf3bda-2bfd-4805-bf46-a616567ce0f1 tempest-VolumeDependencyTests-196036776 None] Created volume successfully. Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "cinder-20c35ecd-8b47-4503-81d8-0ba995139c9b-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:36 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 Jul 24 12:50:36 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-20c35ecd-8b47-4503-81d8-0ba995139c9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "cinder-quobyte-97f47e29-3f42-40d4-9787-ad65b5dd5819" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-97f47e29-3f42-40d4-9787-ad65b5dd5819" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "cinder-quobyte-20c35ecd-8b47-4503-81d8-0ba995139c9b" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-20c35ecd-8b47-4503-81d8-0ba995139c9b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Deleting offline snapshot 20c35ecd-8b47-4503-81d8-0ba995139c9b of volume 97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] snapshot_file for this snap is: volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9d55c3-ba9d-47c9-b9e4-8891076447fb]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:37 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b Jul 24 12:50:37 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:37 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51" returned: 0 in 0.534s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:37 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 1G Jul 24 12:50:37 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:37 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b" returned: 0 in 0.474s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97f47e29-3f42-40d4-9787-ad65b5dd5819(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0517d1f3-5568-42a5-8873-9f1af38be031]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:37 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 Jul 24 12:50:37 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:37 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 1G" returned: 0 in 0.586s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:37 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 Jul 24 12:50:37 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:37 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819" returned: 0 in 0.544s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:38 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b Jul 24 12:50:38 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:38 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91" returned: 0 in 0.336s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:38 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 is being set with open permissions: ugo+rw Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:38 devstack sudo[102754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 Jul 24 12:50:38 devstack sudo[102754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:38 devstack sudo[102754]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91" returned: 0 in 0.268s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:38 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b" returned: 0 in 0.375s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:38 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.info Jul 24 12:50:38 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:38 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b Jul 24 12:50:38 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:38 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819.20c35ecd-8b47-4503-81d8-0ba995139c9b" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:38 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.info" returned: 0 in 0.290s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:38 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.info is being set with open permissions: ugo+rw Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:38 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.info Jul 24 12:50:38 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-20c35ecd-8b47-4503-81d8-0ba995139c9b" released by "_delete_snapshot" :: held 1.802s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-97f47e29-3f42-40d4-9787-ad65b5dd5819" released by "delete_snapshot" :: held 1.839s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Acquiring lock "cinder-4d6f2db8-0727-49c4-8f17-37b6b77bce4d-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Lock "cinder-4d6f2db8-0727-49c4-8f17-37b6b77bce4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Acquiring lock "cinder-quobyte-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Created reservations ['7c64f2af-7a70-4eb5-b32b-bacd42eb7133', 'ac2b80e5-18ca-4c6c-b899-0f88058f4fd0', '6dba4df1-640d-4c16-9551-3cc2aa7db451', '7efecd65-f517-4f1b-94f3-e281190307a6'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1377a0-d3e4-48b4-9896-61aa832a9e0c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:38 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.info" returned: 0 in 0.259s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Delete snapshot completed successfully. Jul 24 12:50:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-88d1b744-642f-44da-9905-df4c07fb4ba1 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-20c35ecd-8b47-4503-81d8-0ba995139c9b-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3a5757da-7fed-4e73-87d5-d3a0ed7c6844 tempest-VolumesExtendTest-626150839 None] Create snapshot completed successfully Jul 24 12:50:38 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d Jul 24 12:50:38 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "cinder-97f47e29-3f42-40d4-9787-ad65b5dd5819-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-97f47e29-3f42-40d4-9787-ad65b5dd5819-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "cinder-quobyte-97f47e29-3f42-40d4-9787-ad65b5dd5819" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-97f47e29-3f42-40d4-9787-ad65b5dd5819" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef01d664-2bfa-464c-b143-030c43cec5dc]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:39 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 Jul 24 12:50:39 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:39 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" returned: 0 in 0.375s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:39 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d Jul 24 12:50:39 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:39 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" returned: 0 in 0.238s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:39 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819" returned: 0 in 0.366s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-4d6f2db8-0727-49c4-8f17-37b6b77bce4d" released by "delete_volume" :: held 0.665s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:39 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819 Jul 24 12:50:39 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Created reservations ['054cf327-11e0-4f40-907c-b9f7d7f2f5c3', '4ab1b94a-c291-45b8-b0a4-2ddfbaffe39b', '25d9737e-c816-4f52-8c0d-d909eae13779', 'd6b7965d-bcc6-403c-aec5-9b5b4424bb34'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:39 devstack sudo[102785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:39 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:39 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-97f47e29-3f42-40d4-9787-ad65b5dd5819" returned: 0 in 0.280s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-97f47e29-3f42-40d4-9787-ad65b5dd5819" released by "delete_volume" :: held 0.706s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Created reservations ['c33c7d24-a652-4a29-b9e0-c1eb5c6e9866', 'a5a2ca82-9c8d-4e75-8edb-41adb7ae6013', '703e2da5-40a9-4527-9657-a738d0282741', '3605d929-297a-404f-ab7a-67800465b744'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:39 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13dac569-8586-4567-aee7-d1fd6aabb08d tempest-VolumesExtendTest-626150839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13dac569-8586-4567-aee7-d1fd6aabb08d tempest-VolumesExtendTest-626150839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.280s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Deleted volume successfully. Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbb54f9-ef40-4043-a326-ae1ad6035f57]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13dac569-8586-4567-aee7-d1fd6aabb08d tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cdccef-1f3a-405d-b631-0fbe42ea4f74 tempest-TestStampPattern-914984710 None] Lock "cinder-4d6f2db8-0727-49c4-8f17-37b6b77bce4d-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:40 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 Jul 24 12:50:40 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:40 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:40 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "cinder-c93b9043-3c73-43ae-8bd6-b66380afd64b-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-c93b9043-3c73-43ae-8bd6-b66380afd64b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "cinder-quobyte-c93b9043-3c73-43ae-8bd6-b66380afd64b" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-c93b9043-3c73-43ae-8bd6-b66380afd64b" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:40 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Acquiring lock "cinder-6a9ad139-f947-4d40-a4df-9cddab92eec4-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67006a3-48da-4d4d-a21d-5661aca20ca1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:40 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.354s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:40 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Deleted volume successfully. Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13dac569-8586-4567-aee7-d1fd6aabb08d tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51" returned: 0 in 0.466s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13dac569-8586-4567-aee7-d1fd6aabb08d tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 2G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Lock "cinder-6a9ad139-f947-4d40-a4df-9cddab92eec4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Acquiring lock "cinder-quobyte-43f45d70-ec0f-41bf-bce9-a481672894af" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25ef4a7d-269d-4d3d-b4e1-4de70c8fd796 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-97f47e29-3f42-40d4-9787-ad65b5dd5819-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-43f45d70-ec0f-41bf-bce9-a481672894af" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Acquiring lock "cinder-quobyte-6a9ad139-f947-4d40-a4df-9cddab92eec4" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-6a9ad139-f947-4d40-a4df-9cddab92eec4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Deleting offline snapshot 6a9ad139-f947-4d40-a4df-9cddab92eec4 of volume 43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] snapshot_file for this snap is: volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:50:40 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b Jul 24 12:50:40 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf942598-922f-454d-977d-3934ea4ca80c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-13dac569-8586-4567-aee7-d1fd6aabb08d tempest-VolumesExtendTest-626150839 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 2G" returned: 0 in 0.170s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-13dac569-8586-4567-aee7-d1fd6aabb08d tempest-VolumesExtendTest-626150839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.679s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:40 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-13dac569-8586-4567-aee7-d1fd6aabb08d tempest-VolumesExtendTest-626150839 None] Extend volume completed successfully. Jul 24 12:50:40 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 Jul 24 12:50:40 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:40 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b" returned: 0 in 0.407s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:40 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b Jul 24 12:50:40 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:40 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4" returned: 0 in 0.402s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43f45d70-ec0f-41bf-bce9-a481672894af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[553a12a0-f365-48b1-ad16-9b55490db2dd]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:41 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c93b9043-3c73-43ae-8bd6-b66380afd64b" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:41 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af Jul 24 12:50:41 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-quobyte-c93b9043-3c73-43ae-8bd6-b66380afd64b" released by "delete_volume" :: held 0.740s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Created reservations ['72721345-a4b6-4e92-aae5-61714b9d996d', 'db3a53cb-c6f3-4c0b-a3a3-a740b68e4ffe', 'c6fb2f7e-9cba-4106-baec-e3a9635ec231', 'dc0abe46-696d-4565-bcbf-f69199e69964'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Acquiring lock "cinder-ab293f1d-720b-411c-813b-29ade9c91b91-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Lock "cinder-ab293f1d-720b-411c-813b-29ade9c91b91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Acquiring lock "cinder-quobyte-0fe5b059-d06d-4cd5-926a-1f145bf42f51" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Lock "cinder-quobyte-0fe5b059-d06d-4cd5-926a-1f145bf42f51" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Acquiring lock "cinder-quobyte-ab293f1d-720b-411c-813b-29ade9c91b91" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Lock "cinder-quobyte-ab293f1d-720b-411c-813b-29ade9c91b91" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Deleting offline snapshot ab293f1d-720b-411c-813b-29ade9c91b91 of volume 0fe5b059-d06d-4cd5-926a-1f145bf42f51 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:50:41 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:41 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] snapshot_file for this snap is: volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d343fc7-3fee-4ceb-b1d2-553ba663465d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:41 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af" returned: 0 in 0.393s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:41 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 Jul 24 12:50:41 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:41 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 Jul 24 12:50:41 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:41 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.301s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Deleted volume successfully. Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-42d3fb47-89ff-43b0-b749-92763afac4e7 tempest-VolumeDependencyTests-196036776 None] Lock "cinder-c93b9043-3c73-43ae-8bd6-b66380afd64b-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:41 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91" returned: 0 in 0.443s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:50:41 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4" returned: 0 in 0.427s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0212d3d-77d2-468b-835b-30a08e3dd547]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:41 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4 Jul 24 12:50:41 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:41 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 Jul 24 12:50:41 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:41 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af.6a9ad139-f947-4d40-a4df-9cddab92eec4" returned: 0 in 0.267s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-6a9ad139-f947-4d40-a4df-9cddab92eec4" released by "_delete_snapshot" :: held 1.593s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-43f45d70-ec0f-41bf-bce9-a481672894af" released by "delete_snapshot" :: held 1.620s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:42 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51" returned: 0 in 0.388s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Created reservations ['3db5dac7-1f90-4128-8ac1-8787b9e7a42e', '1a4af879-6dd9-4c76-8d5d-4aa9272e3e8d', 'e69e0091-8c32-4e7b-bba9-9de0157ae75e', 'c25ef11e-5036-4861-8a52-226ef6cd8de5'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:42 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 Jul 24 12:50:42 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:42 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:42 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:42 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Delete snapshot completed successfully. Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cc3233e-cfb0-4c4f-85a2-f9d0d5e54c61 tempest-TestStampPattern-914984710 None] Lock "cinder-6a9ad139-f947-4d40-a4df-9cddab92eec4-delete_snapshot" released by "delete_snapshot" :: held 1.922s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:42 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.373s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:50:42 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91" returned: 0 in 0.595s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:42 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91 Jul 24 12:50:42 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:43 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51.ab293f1d-720b-411c-813b-29ade9c91b91" returned: 0 in 0.301s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Lock "cinder-quobyte-ab293f1d-720b-411c-813b-29ade9c91b91" released by "_delete_snapshot" :: held 1.901s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Lock "cinder-quobyte-0fe5b059-d06d-4cd5-926a-1f145bf42f51" released by "delete_snapshot" :: held 1.952s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:43 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Created reservations ['338a5975-627a-404f-b7e3-03475b3e94dc', '1898f04e-b90e-41ee-bacb-928eaf8c2d3f', '5f83dfa7-fcea-413e-ab6d-2790acae830c', '4bb09962-8ed5-4be8-a14b-7147edebdd2b'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:43 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Delete snapshot completed successfully. Jul 24 12:50:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-af2f0e93-3717-459a-aa55-70a024dd722f tempest-VolumesExtendTest-626150839 None] Lock "cinder-ab293f1d-720b-411c-813b-29ade9c91b91-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Acquiring lock "cinder-0fe5b059-d06d-4cd5-926a-1f145bf42f51-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Lock "cinder-0fe5b059-d06d-4cd5-926a-1f145bf42f51-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Acquiring lock "cinder-quobyte-0fe5b059-d06d-4cd5-926a-1f145bf42f51" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Lock "cinder-quobyte-0fe5b059-d06d-4cd5-926a-1f145bf42f51" acquired by "delete_volume" :: waited 0.044s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:44 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3b7c21-c8c2-449c-944c-01cab7637d8e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:45 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 Jul 24 12:50:45 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:45 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51" returned: 0 in 0.530s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:45 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51 Jul 24 12:50:45 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:45 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0fe5b059-d06d-4cd5-926a-1f145bf42f51" returned: 0 in 0.425s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:45 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Lock "cinder-quobyte-0fe5b059-d06d-4cd5-926a-1f145bf42f51" released by "delete_volume" :: held 1.076s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:45 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Created reservations ['880ee0ca-9ee6-4385-b373-013849679fca', '56064a47-b544-449f-9566-f8072fe6e4b9', '8e151d64-a0ce-44a2-b1f4-0f5a2064e75a', '6a06e612-bea6-4ee9-9360-dcec6a8b9d65'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:46 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:46 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:46 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:46 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.318s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:46 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:46 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Deleted volume successfully. Jul 24 12:50:46 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29147b00-85c4-4c7c-a266-26e159c8f948 tempest-VolumesExtendTest-626150839 None] Lock "cinder-0fe5b059-d06d-4cd5-926a-1f145bf42f51-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Acquiring lock "cinder-43f45d70-ec0f-41bf-bce9-a481672894af-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Lock "cinder-43f45d70-ec0f-41bf-bce9-a481672894af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-c2ce04ea-2942-4eee-9c7c-914e2131e04b req-f1a601cf-4804-4c79-a376-4492d3d7a22c tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-c2ce04ea-2942-4eee-9c7c-914e2131e04b req-f1a601cf-4804-4c79-a376-4492d3d7a22c tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-c2ce04ea-2942-4eee-9c7c-914e2131e04b req-f1a601cf-4804-4c79-a376-4492d3d7a22c tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Acquiring lock "cinder-quobyte-43f45d70-ec0f-41bf-bce9-a481672894af" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-43f45d70-ec0f-41bf-bce9-a481672894af" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcac1dcb-c17b-4375-a57a-30cc0fb6030f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-c2ce04ea-2942-4eee-9c7c-914e2131e04b req-f1a601cf-4804-4c79-a376-4492d3d7a22c tempest-TestServerVolumeAttachmentScenario-1638256096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bca74f8a-b6e2-4be1-8c60-463a72566280', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:50:47 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-c2ce04ea-2942-4eee-9c7c-914e2131e04b req-f1a601cf-4804-4c79-a376-4492d3d7a22c tempest-TestServerVolumeAttachmentScenario-1638256096 None] attachment_update completed successfully. Jul 24 12:50:47 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af Jul 24 12:50:47 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:47 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af" returned: 0 in 0.462s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:47 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af Jul 24 12:50:47 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:48 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-43f45d70-ec0f-41bf-bce9-a481672894af" returned: 0 in 0.318s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Lock "cinder-quobyte-43f45d70-ec0f-41bf-bce9-a481672894af" released by "delete_volume" :: held 0.853s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Created reservations ['d8e174b1-bd91-4a52-8130-086c2fd8b74c', '8b335872-5e8d-40c5-8531-af3bfbea0c2f', '14eb609e-e897-4edd-9f21-0fefa6bdf8be', '1b1a8e82-acc9-42bb-a0de-522f05ff0084'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:48 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:48 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:48 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.325s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Deleted volume successfully. Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4e34add9-93d7-4992-86a3-6d482e42ee94 tempest-TestStampPattern-914984710 None] Lock "cinder-43f45d70-ec0f-41bf-bce9-a481672894af-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Flow 'volume_create_manager' (06db18a4-6507-4c4d-9de5-a54e8145091e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2307bcec-fb68-48d7-80cb-6fb6285027fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2307bcec-fb68-48d7-80cb-6fb6285027fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f276f36-ea17-4630-b8d4-daa8708fcbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306358b82ef473dbaf865c6e1bd286c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:49Z,use_quota=True,user_id='b39454b07e8e48e0ae577104bf9439e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f3e20a-356c-4e38-ab20-6fea47d16e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f3e20a-356c-4e38-ab20-6fea47d16e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a58598e-430d-436c-aaab-8422ed9ede17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:48 devstack cinder-volume[88540]: DEBUG cinder.image.glance [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Creating Keystone auth plugin from conf {{(pid=88540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 12:50:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a58598e-430d-436c-aaab-8422ed9ede17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f276f36-ea17-4630-b8d4-daa8708fcbb1', 'volume_name': 'volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1', 'volume_size': 1, 'image_id': 'dc598046-b11c-4b91-8b88-4a702561f94e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc598046-b11c-4b91-8b88-4a702561f94e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '485bec8a87264b3faeda59b9c75d94a0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6306358b82ef473dbaf865c6e1bd286c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d1da9fe0b15b05298782e0e112ddf37c68bff8ba5e79b1c5424c774409782cd10a12bed9c81fbec5ccd460ff355209bbafa10554e4de21e0526bd99223b4b6f', 'id': 'dc598046-b11c-4b91-8b88-4a702561f94e', 'created_at': datetime.datetime(2026, 7, 24, 10, 50, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 50, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc598046-b11c-4b91-8b88-4a702561f94e/file', 'properties': {}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab055d5-d33a-440b-a747-a0e88cd29282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ab055d5-d33a-440b-a747-a0e88cd29282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfff8aba-f35d-4472-a678-465e7f9f3e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:49 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Volume 9f276f36-ea17-4630-b8d4-daa8708fcbb1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1', 'volume_size': 1, 'image_id': 'dc598046-b11c-4b91-8b88-4a702561f94e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc598046-b11c-4b91-8b88-4a702561f94e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '485bec8a87264b3faeda59b9c75d94a0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6306358b82ef473dbaf865c6e1bd286c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d1da9fe0b15b05298782e0e112ddf37c68bff8ba5e79b1c5424c774409782cd10a12bed9c81fbec5ccd460ff355209bbafa10554e4de21e0526bd99223b4b6f', 'id': 'dc598046-b11c-4b91-8b88-4a702561f94e', 'created_at': datetime.datetime(2026, 7, 24, 10, 50, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 50, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc598046-b11c-4b91-8b88-4a702561f94e/file', 'properties': {}}, 'image_service': } Jul 24 12:50:49 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Trying to clone 9f276f36-ea17-4630-b8d4-daa8708fcbb1 from image dc598046-b11c-4b91-8b88-4a702561f94e at location (None, [{'url': 'file:///opt/stack/data/glance/images/dc598046-b11c-4b91-8b88-4a702561f94e', 'metadata': {}}]). {{(pid=88540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 12:50:49 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 12:50:49 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Image download 0.00 MB at 0.00 MB/s Jul 24 12:50:49 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d27d8bc-a990-49cd-943c-61105f640bad]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:49 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD Jul 24 12:50:49 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:50 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:50 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD Jul 24 12:50:50 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:50 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD" returned: 1 in 0.433s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:50:50 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Temporary image dc598046-b11c-4b91-8b88-4a702561f94e is fetched for user b39454b07e8e48e0ae577104bf9439e2. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 12:50:50 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1100425-7e37-4ecc-bdb5-1e255aa5b62d]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:50 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD Jul 24 12:50:50 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:51 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:51 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD Jul 24 12:50:51 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:50:51 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (cf03db01-34a8-4c5f-9437-05402e5cc881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfc3c82-09c5-436a-bfb1-ae50a1bb810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD" returned: 1 in 0.463s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f276f36-ea17-4630-b8d4-daa8708fcbb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6306358b82ef473dbaf865c6e1bd286c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:49Z,use_quota=True,user_id='b39454b07e8e48e0ae577104bf9439e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Creating volume 9f276f36-ea17-4630-b8d4-daa8708fcbb1 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:50:51 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:51 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 1073741824 Jul 24 12:50:51 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcfc3c82-09c5-436a-bfb1-ae50a1bb810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-411476239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fc8ba8-d7b0-489b-a676-408a7317afb1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:52Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1871f6c-f4ca-4ec8-afea-423dca2f4d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1871f6c-f4ca-4ec8-afea-423dca2f4d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7064ea0-5fff-46b8-af14-dc21bb948ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7064ea0-5fff-46b8-af14-dc21bb948ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fc8ba8-d7b0-489b-a676-408a7317afb1', 'volume_name': 'volume-13fc8ba8-d7b0-489b-a676-408a7317afb1', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e13fba3-1cd2-49fd-968d-63265393fbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e13fba3-1cd2-49fd-968d-63265393fbdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e87676d-f62d-49a0-a432-53ae5557dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:51 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Volume 13fc8ba8-d7b0-489b-a676-408a7317afb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fc8ba8-d7b0-489b-a676-408a7317afb1', 'volume_size': 1} Jul 24 12:50:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:52 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 1073741824" returned: 0 in 0.599s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:52 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 Jul 24 12:50:52 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:52 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1" returned: 0 in 0.435s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-411476239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fc8ba8-d7b0-489b-a676-408a7317afb1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:52Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Creating volume 13fc8ba8-d7b0-489b-a676-408a7317afb1 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:50:52 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:52 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 1073741824 Jul 24 12:50:52 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Attempting download of dc598046-b11c-4b91-8b88-4a702561f94e ((None, [{'url': 'file:///opt/stack/data/glance/images/dc598046-b11c-4b91-8b88-4a702561f94e', 'metadata': {}}])) to volume 9f276f36-ea17-4630-b8d4-daa8708fcbb1. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a603e7-3bb3-4308-8f72-d28a70e16de6]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc598046-b11c-4b91-8b88-4a702561f94e_vxtbwguw {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:53 devstack sudo[103375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc598046-b11c-4b91-8b88-4a702561f94e_vxtbwguw Jul 24 12:50:53 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-d9c896ff-8dde-4abe-aa59-6b62205d19a0 req-b0d28956-f945-443b-9f38-6d951161656a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:53 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 1073741824" returned: 0 in 0.551s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:53 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc598046-b11c-4b91-8b88-4a702561f94e_vxtbwguw" returned: 0 in 0.441s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc598046-b11c-4b91-8b88-4a702561f94e_vxtbwguw {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:53 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 Jul 24 12:50:53 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:53 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc598046-b11c-4b91-8b88-4a702561f94e_vxtbwguw Jul 24 12:50:53 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:53 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1" returned: 0 in 0.305s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-d9c896ff-8dde-4abe-aa59-6b62205d19a0 req-b0d28956-f945-443b-9f38-6d951161656a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.464s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:53 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc598046-b11c-4b91-8b88-4a702561f94e_vxtbwguw" returned: 1 in 0.385s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc598046-b11c-4b91-8b88-4a702561f94e_vxtbwguw' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e87676d-f62d-49a0-a432-53ae5557dd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fc8ba8-d7b0-489b-a676-408a7317afb1', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5340d5f3-f4f9-4c78-8f40-88d5395c209a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f9e38-c436-4366-a7e6-a703bb20e608]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-d9c896ff-8dde-4abe-aa59-6b62205d19a0 req-b0d28956-f945-443b-9f38-6d951161656a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.088s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:53 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Volume volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 (13fc8ba8-d7b0-489b-a676-408a7317afb1): created successfully Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5340d5f3-f4f9-4c78-8f40-88d5395c209a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (cf03db01-34a8-4c5f-9437-05402e5cc881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-303c28b9-8761-4c69-9851-c456a6dcc831 tempest-VolumesGetTest-441918362 None] Created volume successfully. Jul 24 12:50:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-d9c896ff-8dde-4abe-aa59-6b62205d19a0 req-b0d28956-f945-443b-9f38-6d951161656a tempest-TestServerVolumeAttachmentScenario-1638256096 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-78a123ac-05e2-4334-ba27-a17676540d8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e4aaf12-ec10-4d38-a040-07200c9d5bd7', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:50:53 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD Jul 24 12:50:53 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-d9c896ff-8dde-4abe-aa59-6b62205d19a0 req-b0d28956-f945-443b-9f38-6d951161656a tempest-TestServerVolumeAttachmentScenario-1638256096 None] attachment_update completed successfully. Jul 24 12:50:54 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:54 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD Jul 24 12:50:54 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:54 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD" returned: 1 in 0.371s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:50:54 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] dc598046-b11c-4b91-8b88-4a702561f94e was raw, converting to qcow2 {{(pid=88540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 12:50:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:54 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 Jul 24 12:50:54 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:55 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1" returned: 0 in 0.677s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dc598046-b11c-4b91-8b88-4a702561f94e_nd_lxe09devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:50:55 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:55 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 1G Jul 24 12:50:55 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:55 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 1G" returned: 0 in 0.440s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Downloaded image dc598046-b11c-4b91-8b88-4a702561f94e ((None, [{'url': 'file:///opt/stack/data/glance/images/dc598046-b11c-4b91-8b88-4a702561f94e', 'metadata': {}}])) to volume 9f276f36-ea17-4630-b8d4-daa8708fcbb1 successfully. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Temporary image dc598046-b11c-4b91-8b88-4a702561f94e for user b39454b07e8e48e0ae577104bf9439e2 is deleted. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Marking volume 9f276f36-ea17-4630-b8d4-daa8708fcbb1 as bootable. {{(pid=88540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Copying metadata from image dc598046-b11c-4b91-8b88-4a702561f94e to 9f276f36-ea17-4630-b8d4-daa8708fcbb1. {{(pid=88540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Creating volume glance metadata for volume 9f276f36-ea17-4630-b8d4-daa8708fcbb1 backed by image dc598046-b11c-4b91-8b88-4a702561f94e with: {'image_id': 'dc598046-b11c-4b91-8b88-4a702561f94e', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '485bec8a87264b3faeda59b9c75d94a0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (73ecb902-b5e2-4309-86bd-e86484645575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6540f6c8-1f90-4729-8b0a-13d87958b4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6540f6c8-1f90-4729-8b0a-13d87958b4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-562113455',display_name='tempest-VolumesGetTest-Volume-1531216088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359f24d6-5128-451c-a6ea-d1e607679bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:56Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99130392-835c-4bce-ae40-032055560cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99130392-835c-4bce-ae40-032055560cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c77dad8-a9db-4bcc-ac2b-04273b6cf860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c77dad8-a9db-4bcc-ac2b-04273b6cf860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359f24d6-5128-451c-a6ea-d1e607679bde', 'volume_name': 'volume-359f24d6-5128-451c-a6ea-d1e607679bde', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c582c1d-b6cc-4f92-82bd-122ac836201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c582c1d-b6cc-4f92-82bd-122ac836201f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77bd3c92-479e-4847-a616-d176ee41131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:55 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Volume 359f24d6-5128-451c-a6ea-d1e607679bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359f24d6-5128-451c-a6ea-d1e607679bde', 'volume_size': 1} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:50:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-562113455',display_name='tempest-VolumesGetTest-Volume-1531216088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359f24d6-5128-451c-a6ea-d1e607679bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:50:56Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Creating volume 359f24d6-5128-451c-a6ea-d1e607679bde {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:50:55 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:55 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde 1073741824 Jul 24 12:50:55 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfff8aba-f35d-4472-a678-465e7f9f3e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1', 'volume_size': 1, 'image_id': 'dc598046-b11c-4b91-8b88-4a702561f94e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc598046-b11c-4b91-8b88-4a702561f94e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '485bec8a87264b3faeda59b9c75d94a0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6306358b82ef473dbaf865c6e1bd286c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d1da9fe0b15b05298782e0e112ddf37c68bff8ba5e79b1c5424c774409782cd10a12bed9c81fbec5ccd460ff355209bbafa10554e4de21e0526bd99223b4b6f', 'id': 'dc598046-b11c-4b91-8b88-4a702561f94e', 'created_at': datetime.datetime(2026, 7, 24, 10, 50, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 50, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc598046-b11c-4b91-8b88-4a702561f94e/file', 'properties': {}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b73c211-04ad-464f-8cab-719f0f045ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:55 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Volume volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 (9f276f36-ea17-4630-b8d4-daa8708fcbb1): created successfully Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b73c211-04ad-464f-8cab-719f0f045ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Flow 'volume_create_manager' (06db18a4-6507-4c4d-9de5-a54e8145091e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-053126e8-6342-4f7d-b15b-45ee663a3e99 tempest-VolumeImageDependencyTests-2060097967 None] Created volume successfully. Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Acquiring lock "cinder-9f276f36-ea17-4630-b8d4-daa8708fcbb1-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Lock "cinder-9f276f36-ea17-4630-b8d4-daa8708fcbb1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-f3f29026-7528-443b-b261-4fd8ad387fa2 req-d3b9b63d-4417-4187-a0f1-44b2c0d4b05b tempest-TestServerVolumeAttachmentScenario-1638256096 None] Terminate volume connection completed successfully. Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-f3f29026-7528-443b-b261-4fd8ad387fa2 req-d3b9b63d-4417-4187-a0f1-44b2c0d4b05b tempest-TestServerVolumeAttachmentScenario-1638256096 None] Deleting attachment 5e4aaf12-ec10-4d38-a040-07200c9d5bd7. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Acquiring lock "cinder-quobyte-9f276f36-ea17-4630-b8d4-daa8708fcbb1" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:56 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde 1073741824" returned: 0 in 0.601s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Lock "cinder-quobyte-9f276f36-ea17-4630-b8d4-daa8708fcbb1" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[220c49bc-787a-4158-99b2-76b27593a296]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:56 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde Jul 24 12:50:56 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:56 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 Jul 24 12:50:56 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:56 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde" returned: 0 in 0.292s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77bd3c92-479e-4847-a616-d176ee41131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359f24d6-5128-451c-a6ea-d1e607679bde', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ecdb11-dfdf-4ca2-ac58-05ebe4df1859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:50:56 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Volume volume-359f24d6-5128-451c-a6ea-d1e607679bde (359f24d6-5128-451c-a6ea-d1e607679bde): created successfully Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48ecdb11-dfdf-4ca2-ac58-05ebe4df1859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (73ecb902-b5e2-4309-86bd-e86484645575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:50:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-79469dd8-e20a-4a00-a012-9072644ac834 tempest-VolumesGetTest-441918362 None] Created volume successfully. Jul 24 12:50:56 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1" returned: 0 in 0.445s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:56 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1 Jul 24 12:50:56 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:57 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f276f36-ea17-4630-b8d4-daa8708fcbb1" returned: 0 in 0.270s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Lock "cinder-quobyte-9f276f36-ea17-4630-b8d4-daa8708fcbb1" released by "delete_volume" :: held 0.769s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Created reservations ['c6e8f0f3-d72f-4549-a8de-de934a0a876b', 'e5637cb5-c92f-4c8a-97e3-43bc02f68775', 'a6e91464-0f9d-4abe-89f5-a0d4f6f258a7', '18c1b3a9-1cc8-4c57-bc15-9580476a3f03'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:57 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:57 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:57 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.361s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:57 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Deleted volume successfully. Jul 24 12:50:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-305e2883-13df-4f32-bf01-2010f83fa70c tempest-VolumeImageDependencyTests-2060097967 None] Lock "cinder-9f276f36-ea17-4630-b8d4-daa8708fcbb1-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:58 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-7a167fa5-b0e2-47cf-8a15-9987482f0cad req-d5ea80a4-5459-4be0-a3a0-81beab1badc4 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Terminate volume connection completed successfully. Jul 24 12:50:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-7a167fa5-b0e2-47cf-8a15-9987482f0cad req-d5ea80a4-5459-4be0-a3a0-81beab1badc4 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Deleting attachment bca74f8a-b6e2-4be1-8c60-463a72566280. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:50:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-359f24d6-5128-451c-a6ea-d1e607679bde-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Lock "cinder-359f24d6-5128-451c-a6ea-d1e607679bde-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-quobyte-359f24d6-5128-451c-a6ea-d1e607679bde" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:50:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-359f24d6-5128-451c-a6ea-d1e607679bde" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:50:58 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fd723c-2f53-4d2e-a1c0-307ec36ce2d8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:50:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:58 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde Jul 24 12:50:58 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:58 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde" returned: 0 in 0.519s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:58 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde Jul 24 12:50:58 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:59 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-359f24d6-5128-451c-a6ea-d1e607679bde" returned: 0 in 0.362s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-359f24d6-5128-451c-a6ea-d1e607679bde" released by "delete_volume" :: held 0.943s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Created reservations ['5a4415d7-77bb-4783-97e7-767f668d751e', '9d509d63-3909-4e84-b100-db0de1fd0cd4', 'bf82187e-4177-4901-979f-cba92083523d', '4b0fb7ea-32d5-4a0f-bd3c-db9859c9c629'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:50:59 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:50:59 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:50:59 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.544s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:50:59 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Deleted volume successfully. Jul 24 12:50:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9db684b7-2bb6-47a5-a36d-60ad0e73ebba tempest-VolumesGetTest-441918362 None] Lock "cinder-359f24d6-5128-451c-a6ea-d1e607679bde-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-13fc8ba8-d7b0-489b-a676-408a7317afb1-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Lock "cinder-13fc8ba8-d7b0-489b-a676-408a7317afb1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-quobyte-13fc8ba8-d7b0-489b-a676-408a7317afb1" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-13fc8ba8-d7b0-489b-a676-408a7317afb1" acquired by "delete_volume" :: waited 0.038s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:00 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67f4cc0-afe9-4720-a358-05b613886653]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:00 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 Jul 24 12:51:00 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:01 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1" returned: 0 in 0.419s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:01 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1 Jul 24 12:51:01 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:01 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-13fc8ba8-d7b0-489b-a676-408a7317afb1" returned: 0 in 0.339s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-13fc8ba8-d7b0-489b-a676-408a7317afb1" released by "delete_volume" :: held 0.839s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Created reservations ['c6ff022a-18e3-4eb8-8430-eff30bc6b745', 'af38349b-d88b-41b9-acbe-c7c55fc274e5', '17efcfd8-ffee-4a45-8977-b6178baa6e64', 'c080f061-6f62-46b3-9904-09767d6f9c86'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:01 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:01 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:01 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.288s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:01 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:01 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Deleted volume successfully. Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1ebd2a14-c8a1-428b-873c-ee59961d8cdf tempest-VolumesGetTest-441918362 None] Lock "cinder-13fc8ba8-d7b0-489b-a676-408a7317afb1-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (6351d4bf-bb13-4069-9627-472b2d0f4384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119965b3-88fa-4981-9cd6-dddc410fe161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119965b3-88fa-4981-9cd6-dddc410fe161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-259576297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70170d85-9616-4048-9a89-bb529766b135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:02Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89af4096-f844-4fb0-a128-9c96622e0901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89af4096-f844-4fb0-a128-9c96622e0901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a77589-2f9f-45de-852a-b725f2bd9d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a77589-2f9f-45de-852a-b725f2bd9d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70170d85-9616-4048-9a89-bb529766b135', 'volume_name': 'volume-70170d85-9616-4048-9a89-bb529766b135', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06bac8e-d516-46fa-a2dd-5d876ac99d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06bac8e-d516-46fa-a2dd-5d876ac99d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe68992-3127-45a2-a249-5178131e0b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:02 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Volume 70170d85-9616-4048-9a89-bb529766b135: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70170d85-9616-4048-9a89-bb529766b135', 'volume_size': 1} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-259576297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70170d85-9616-4048-9a89-bb529766b135,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:02Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Creating volume 70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:02 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:02 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 1073741824 Jul 24 12:51:02 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:02 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 1073741824" returned: 0 in 0.520s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:03 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 Jul 24 12:51:03 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:03 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135" returned: 0 in 0.288s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe68992-3127-45a2-a249-5178131e0b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70170d85-9616-4048-9a89-bb529766b135', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f67d865-43cd-4a44-b0b4-8341a70831d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:03 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Volume volume-70170d85-9616-4048-9a89-bb529766b135 (70170d85-9616-4048-9a89-bb529766b135): created successfully Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f67d865-43cd-4a44-b0b4-8341a70831d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (6351d4bf-bb13-4069-9627-472b2d0f4384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-54bd821c-29e1-41a3-a950-70417bb01597 tempest-VolumesGetTest-441918362 None] Created volume successfully. Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "cinder-78a123ac-05e2-4334-ba27-a17676540d8c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "cinder-78a123ac-05e2-4334-ba27-a17676540d8c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "cinder-quobyte-78a123ac-05e2-4334-ba27-a17676540d8c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "cinder-quobyte-78a123ac-05e2-4334-ba27-a17676540d8c" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0e4d3e-5987-4f1f-a31d-f169de98b6d2]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:03 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c Jul 24 12:51:03 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:04 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c" returned: 0 in 0.399s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:04 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c Jul 24 12:51:04 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (8bff053c-f6bd-4cfe-8893-9a44756e7e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7165bda6-73e7-4c18-9ebe-75a524bf6130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7165bda6-73e7-4c18-9ebe-75a524bf6130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1354742968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4f2bf7-f105-4f4c-8148-425ea376ec4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:04Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de43dcf9-dde3-4b44-a68a-ba41f4a5c5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de43dcf9-dde3-4b44-a68a-ba41f4a5c5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caeaac6-7a3f-45a6-8395-9ab4d90fd431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7caeaac6-7a3f-45a6-8395-9ab4d90fd431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a4f2bf7-f105-4f4c-8148-425ea376ec4f', 'volume_name': 'volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd108bcd-4ba5-464a-b5eb-05ba102ca00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd108bcd-4ba5-464a-b5eb-05ba102ca00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d108e0f-715d-4f50-8df7-483195a30d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Volume 5a4f2bf7-f105-4f4c-8148-425ea376ec4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f', 'volume_size': 1} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1354742968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a4f2bf7-f105-4f4c-8148-425ea376ec4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:04Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Creating volume 5a4f2bf7-f105-4f4c-8148-425ea376ec4f {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:04 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:04 devstack sudo[103567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f 1073741824 Jul 24 12:51:04 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:04 devstack sudo[103567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-78a123ac-05e2-4334-ba27-a17676540d8c" returned: 0 in 0.279s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "cinder-quobyte-78a123ac-05e2-4334-ba27-a17676540d8c" released by "delete_volume" :: held 0.735s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Created reservations ['78d011d2-1c82-4f43-a40e-0b28359be184', 'babe6344-68b2-4e7f-8b02-0419bd5f2647', '3d0427b5-ab00-44e6-a41e-eabbfcc24e55', '9e4dfdfc-3cde-4d9f-994b-660c3bf82788'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:04 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:04 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (d739e2c4-013e-4e23-bb5d-ebc4d41291cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02f2ab7-7255-4775-9801-3fc95c14a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e02f2ab7-7255-4775-9801-3fc95c14a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-82413156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89476ad2-e76a-440b-9eae-bdc305a72c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:05Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f191758e-5f1e-497d-bc4f-024ca4e09f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f191758e-5f1e-497d-bc4f-024ca4e09f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0f7761-4466-49a1-9860-9afe7fb5eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc0f7761-4466-49a1-9860-9afe7fb5eec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89476ad2-e76a-440b-9eae-bdc305a72c4e', 'volume_name': 'volume-89476ad2-e76a-440b-9eae-bdc305a72c4e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec248a1-e570-4aec-a9de-c718dfd42f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec248a1-e570-4aec-a9de-c718dfd42f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e255f1-2147-4e7f-9698-f30ed4cf64aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:04 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Volume 89476ad2-e76a-440b-9eae-bdc305a72c4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89476ad2-e76a-440b-9eae-bdc305a72c4e', 'volume_size': 1} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:04 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.425s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:04 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Deleted volume successfully. Jul 24 12:51:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-95f2a361-caf2-4770-b9c2-c309ce77d9be tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "cinder-78a123ac-05e2-4334-ba27-a17676540d8c-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:05 devstack sudo[103567]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f 1073741824" returned: 0 in 0.766s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "cinder-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:05 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f Jul 24 12:51:05 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "cinder-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "cinder-quobyte-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "cinder-quobyte-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bb3301-b76d-42a3-b4d4-cc0c50c453f5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:05 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 Jul 24 12:51:05 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:05 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (0f063b61-eb2d-4ca0-9920-8ba476a98daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb43382-19da-437c-8f5a-11e166887601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f" returned: 0 in 0.425s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.754s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-82413156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89476ad2-e76a-440b-9eae-bdc305a72c4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:05Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Creating volume 89476ad2-e76a-440b-9eae-bdc305a72c4e {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:05 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d108e0f-715d-4f50-8df7-483195a30d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e795dede-d2a9-44a4-81a0-8c8fc09db0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e 1073741824 Jul 24 12:51:05 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb43382-19da-437c-8f5a-11e166887601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-808661423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9061e4ad-39c2-412a-a5e2-dc18bb8d91b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:05Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae99d00c-1017-4836-b993-3efde4d8d9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae99d00c-1017-4836-b993-3efde4d8d9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354c92e9-15ba-442b-8af0-ee534d9ff7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354c92e9-15ba-442b-8af0-ee534d9ff7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9061e4ad-39c2-412a-a5e2-dc18bb8d91b9', 'volume_name': 'volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e849428-b6d7-4518-b282-f99252b6ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e849428-b6d7-4518-b282-f99252b6ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d5ee3a-7039-43d6-94d9-d133c7530934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Volume 9061e4ad-39c2-412a-a5e2-dc18bb8d91b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9', 'volume_size': 1} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:05 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Volume volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f (5a4f2bf7-f105-4f4c-8148-425ea376ec4f): created successfully Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e795dede-d2a9-44a4-81a0-8c8fc09db0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (8bff053c-f6bd-4cfe-8893-9a44756e7e5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:05 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8" returned: 0 in 0.442s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:05 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8 Jul 24 12:51:05 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:05 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d39854d5-273e-433c-b738-60fb6b1c161b tempest-CreateVolumesFromImageTest-434138548 None] Created volume successfully. Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (80992c8a-ee0e-4981-8573-894cdfa761a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420e5684-1163-45d4-b4da-27640b62f814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (420e5684-1163-45d4-b4da-27640b62f814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1327024875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e6d63c-d831-4897-894a-b03628f1f583,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=70170d85-9616-4048-9a89-bb529766b135,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:06Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa5fe7a-eae6-45c7-b4d3-5a6a070c2a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa5fe7a-eae6-45c7-b4d3-5a6a070c2a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab744dfc-6df6-443f-a750-a9578ab65ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab744dfc-6df6-443f-a750-a9578ab65ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '41e6d63c-d831-4897-894a-b03628f1f583', 'volume_name': 'volume-41e6d63c-d831-4897-894a-b03628f1f583', 'volume_size': 1, 'source_volid': '70170d85-9616-4048-9a89-bb529766b135', 'source_volstatus': 'available'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782e266e-e6dc-4c40-91cb-d1ceb53b6d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (782e266e-e6dc-4c40-91cb-d1ceb53b6d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1382ea7-0d1f-4fe0-8840-1ebf63076bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Volume 41e6d63c-d831-4897-894a-b03628f1f583: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-41e6d63c-d831-4897-894a-b03628f1f583', 'volume_size': 1, 'source_volid': '70170d85-9616-4048-9a89-bb529766b135', 'source_volstatus': 'available'} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (2bb5e41a-f485-4862-880b-b749eecb750b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab9ada8-6c4c-4502-9c35-3af048eda359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab9ada8-6c4c-4502-9c35-3af048eda359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-104828076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbed7013-b956-4793-94e9-62d27323948b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:06Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331bde5a-4846-4c6c-85ff-12f7aea3f8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331bde5a-4846-4c6c-85ff-12f7aea3f8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d13ad6d-c2d8-478e-9004-7bb67456c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d13ad6d-c2d8-478e-9004-7bb67456c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbed7013-b956-4793-94e9-62d27323948b', 'volume_name': 'volume-cbed7013-b956-4793-94e9-62d27323948b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74655e3-47a9-4c96-9c9c-710ebdd4557f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:06 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74655e3-47a9-4c96-9c9c-710ebdd4557f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc614bc-f64e-4917-b888-c34c69ad9e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:06 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Volume cbed7013-b956-4793-94e9-62d27323948b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbed7013-b956-4793-94e9-62d27323948b', 'volume_size': 1} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8" returned: 0 in 0.329s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "cinder-quobyte-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8" released by "delete_volume" :: held 0.830s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Created reservations ['33f7c49d-f197-438d-a0a6-024235aed019', '96fe14ad-9add-4e6c-8afe-ce115cf01264', 'fc6e1b0b-d5d6-41d7-9617-fd30940f9a2b', '2b7afca5-44f9-4bce-aeb7-34c5e096f294'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:06 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e 1073741824" returned: 0 in 0.601s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:06 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:06 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:06 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e Jul 24 12:51:06 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (df6b3c29-b6dc-4add-ad63-a4b6f217cfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1845aac-dffe-429f-bc12-ac7c21dd4041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1845aac-dffe-429f-bc12-ac7c21dd4041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-700373213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910cae47-dacf-4ee0-94e5-489f0f365c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:06Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f27286a-a877-4ab3-ae6d-beea1d63f693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f27286a-a877-4ab3-ae6d-beea1d63f693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202bc781-578f-4c76-bfc8-a926d547c77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202bc781-578f-4c76-bfc8-a926d547c77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910cae47-dacf-4ee0-94e5-489f0f365c4d', 'volume_name': 'volume-910cae47-dacf-4ee0-94e5-489f0f365c4d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34900ad6-2f89-49e4-a4d8-4265ce57cec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34900ad6-2f89-49e4-a4d8-4265ce57cec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf7f087-eff0-4a8c-bd25-6c8c3b50635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:06 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Volume 910cae47-dacf-4ee0-94e5-489f0f365c4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910cae47-dacf-4ee0-94e5-489f0f365c4d', 'volume_size': 1} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:06 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.279s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Deleted volume successfully. Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecde1022-f24b-4ef8-82cd-c27f00e74cf6 tempest-TestServerVolumeAttachmentScenario-1638256096 None] Lock "cinder-b803d77b-3dc5-44d5-b6d9-0c4e1a4feed8-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:06 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e" returned: 0 in 0.302s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-808661423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9061e4ad-39c2-412a-a5e2-dc18bb8d91b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:05Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Creating volume 9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:06 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e255f1-2147-4e7f-9698-f30ed4cf64aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89476ad2-e76a-440b-9eae-bdc305a72c4e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65dc90f-89ad-4970-8a84-b7101ac2a7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:06 devstack sudo[103601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 1073741824 Jul 24 12:51:06 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:06 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Volume volume-89476ad2-e76a-440b-9eae-bdc305a72c4e (89476ad2-e76a-440b-9eae-bdc305a72c4e): created successfully Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65dc90f-89ad-4970-8a84-b7101ac2a7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (d739e2c4-013e-4e23-bb5d-ebc4d41291cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ae3d8bfa-c021-45c6-8ecf-e6a2a0663470 tempest-CreateVolumesFromImageTest-434138548 None] Created volume successfully. Jul 24 12:51:07 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 1073741824" returned: 0 in 0.515s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:07 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 Jul 24 12:51:07 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:07 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9" returned: 0 in 0.306s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.347s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-104828076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbed7013-b956-4793-94e9-62d27323948b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:06Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Creating volume cbed7013-b956-4793-94e9-62d27323948b {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:07 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:07 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b 1073741824 Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d5ee3a-7039-43d6-94d9-d133c7530934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:07 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31426433-be6e-43a0-9ffe-b8f77c5f0d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:07 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Volume volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 (9061e4ad-39c2-412a-a5e2-dc18bb8d91b9): created successfully Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31426433-be6e-43a0-9ffe-b8f77c5f0d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (0f063b61-eb2d-4ca0-9920-8ba476a98daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:07 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2cd80c16-62b4-48ac-bb09-773a84c691d6 tempest-CreateVolumesFromImageTest-434138548 None] Created volume successfully. Jul 24 12:51:07 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b 1073741824" returned: 0 in 0.564s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:08 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b Jul 24 12:51:08 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:08 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b" returned: 0 in 0.276s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.240s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:08 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Cloning volume 70170d85-9616-4048-9a89-bb529766b135 to volume 41e6d63c-d831-4897-894a-b03628f1f583 Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:INSERT=49,cinder:UPDATE=181,cinder:SELECT=168,cinder:DELETE=16 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fc614bc-f64e-4917-b888-c34c69ad9e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbed7013-b956-4793-94e9-62d27323948b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1d040d-3d88-45a1-b990-7e8d93f1db70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:08 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Volume volume-cbed7013-b956-4793-94e9-62d27323948b (cbed7013-b956-4793-94e9-62d27323948b): created successfully Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af1d040d-3d88-45a1-b990-7e8d93f1db70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (2bb5e41a-f485-4862-880b-b749eecb750b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Creating offline snapshot e927fd47-173a-419c-ab2c-1cc54e75ddab of volume 70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:51:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f336a93e-3908-448a-8a3c-9f0a23f771ca tempest-CreateVolumesFromImageTest-434138548 None] Created volume successfully. Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[189fdf76-7ec4-4371-b49f-b7357077e3f5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:08 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 Jul 24 12:51:08 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:08 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135" returned: 0 in 0.389s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:08 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab 1G Jul 24 12:51:08 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:09 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab 1G" returned: 0 in 0.419s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70170d85-9616-4048-9a89-bb529766b135 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:09 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70170d85-9616-4048-9a89-bb529766b135 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab Jul 24 12:51:09 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:09 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70170d85-9616-4048-9a89-bb529766b135 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab" returned: 0 in 0.391s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:09 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab is being set with open permissions: ugo+rw Jul 24 12:51:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:09 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab Jul 24 12:51:09 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:09 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab" returned: 0 in 0.240s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:09 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=164,cinder:INSERT=58,cinder:UPDATE=192,cinder:DELETE=14 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:51:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:09 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.info Jul 24 12:51:09 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:10 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.info" returned: 0 in 0.278s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:10 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.info is being set with open permissions: ugo+rw Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:10 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.info Jul 24 12:51:10 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:10 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.info" returned: 0 in 0.264s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-quobyte-41e6d63c-d831-4897-894a-b03628f1f583" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-41e6d63c-d831-4897-894a-b03628f1f583" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] snapshot: e927fd47-173a-419c-ab2c-1cc54e75ddab, volume: 41e6d63c-d831-4897-894a-b03628f1f583, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4535d8-861b-4ff1-ad7c-f6bee42a889a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:10 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab Jul 24 12:51:10 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:10 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab" returned: 0 in 0.387s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70170d85-9616-4048-9a89-bb529766b135(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f1d3d3-1cdb-4b49-92cf-d442a567d39a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:10 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 Jul 24 12:51:10 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:11 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135" returned: 0 in 0.359s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:11 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:51:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:11 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 Jul 24 12:51:11 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:16 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583" returned: 0 in 4.969s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:16 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdce81c1-70c2-4fa9-8c1d-e9c18314b1ec]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:16 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 Jul 24 12:51:16 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:16 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135" returned: 0 in 0.550s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:16 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:51:16 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Converted 1024.00 MB image at 206.03 MB/s Jul 24 12:51:16 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 is being set with open permissions: ugo+rw Jul 24 12:51:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:16 devstack sudo[103678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 Jul 24 12:51:16 devstack sudo[103678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:17 devstack sudo[103678]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583" returned: 0 in 0.242s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-41e6d63c-d831-4897-894a-b03628f1f583" released by "_copy_volume_from_snapshot" :: held 6.584s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-quobyte-e927fd47-173a-419c-ab2c-1cc54e75ddab" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-e927fd47-173a-419c-ab2c-1cc54e75ddab" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Deleting offline snapshot e927fd47-173a-419c-ab2c-1cc54e75ddab of volume 70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] snapshot_file for this snap is: volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e965471d-cf9d-4c5f-9b78-2871af900ef8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:17 devstack sudo[103681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab Jul 24 12:51:17 devstack sudo[103681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:17 devstack sudo[103681]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab" returned: 0 in 0.376s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70170d85-9616-4048-9a89-bb529766b135(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[528a499d-48b0-4203-bd9d-40cd7e62ac1a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:17 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 Jul 24 12:51:17 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:17 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135" returned: 0 in 0.368s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:17 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab Jul 24 12:51:17 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:18 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab" returned: 0 in 0.326s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:18 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab Jul 24 12:51:18 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:18 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135.e927fd47-173a-419c-ab2c-1cc54e75ddab" returned: 0 in 0.269s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-e927fd47-173a-419c-ab2c-1cc54e75ddab" released by "_delete_snapshot" :: held 1.433s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.262s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.184s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-700373213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910cae47-dacf-4ee0-94e5-489f0f365c4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ea280eb9d0b454e9900436a9d6c9267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:06Z,use_quota=True,user_id='b069389d56144a0d951923a1780f7be4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Creating volume 910cae47-dacf-4ee0-94e5-489f0f365c4d {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:18 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1382ea7-0d1f-4fe0-8840-1ebf63076bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e6d63c-d831-4897-894a-b03628f1f583', 'volume_size': 1, 'source_volid': '70170d85-9616-4048-9a89-bb529766b135', 'source_volstatus': 'available'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:18 devstack sudo[103699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d 1073741824 Jul 24 12:51:18 devstack sudo[103699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffef9f4a-fda1-4879-b0b2-3b90036041a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:18 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Volume volume-41e6d63c-d831-4897-894a-b03628f1f583 (41e6d63c-d831-4897-894a-b03628f1f583): created successfully Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffef9f4a-fda1-4879-b0b2-3b90036041a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (80992c8a-ee0e-4981-8573-894cdfa761a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a623f022-cffb-475a-83c1-998d78e9bbc1 tempest-VolumesGetTest-441918362 None] Created volume successfully. Jul 24 12:51:18 devstack sudo[103699]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d 1073741824" returned: 0 in 0.443s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:19 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d Jul 24 12:51:19 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:19 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d" returned: 0 in 0.252s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf7f087-eff0-4a8c-bd25-6c8c3b50635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910cae47-dacf-4ee0-94e5-489f0f365c4d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1defb325-736e-48c1-bd4d-dbc3370a0160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Volume volume-910cae47-dacf-4ee0-94e5-489f0f365c4d (910cae47-dacf-4ee0-94e5-489f0f365c4d): created successfully Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1defb325-736e-48c1-bd4d-dbc3370a0160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Flow 'volume_create_manager' (df6b3c29-b6dc-4add-ad63-a4b6f217cfbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7c5c376c-fc59-4b77-be7d-b9f2efbf314a tempest-CreateVolumesFromImageTest-434138548 None] Created volume successfully. Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-910cae47-dacf-4ee0-94e5-489f0f365c4d-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-910cae47-dacf-4ee0-94e5-489f0f365c4d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-quobyte-910cae47-dacf-4ee0-94e5-489f0f365c4d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-910cae47-dacf-4ee0-94e5-489f0f365c4d" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7642ac-c352-4920-aad2-07667c40a2dd]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:19 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d Jul 24 12:51:19 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:20 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d" returned: 0 in 0.397s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:20 devstack sudo[103713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d Jul 24 12:51:20 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (06f14867-bd2b-4556-a20f-434404ef4f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3581737-356b-4d68-89a9-e88a43b856ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3581737-356b-4d68-89a9-e88a43b856ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1614386643',display_name='tempest-VolumesGetTest-Volume-1232285089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf1e8c2-877e-4099-95d6-b5e0278284ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:20Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042519c1-2c63-41fa-a090-a5a4fee954e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042519c1-2c63-41fa-a090-a5a4fee954e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1a51e8-14be-4d49-99e6-396c2542c7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce1a51e8-14be-4d49-99e6-396c2542c7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf1e8c2-877e-4099-95d6-b5e0278284ef', 'volume_name': 'volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0956e6-388f-4fb9-9937-131e896e176e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0956e6-388f-4fb9-9937-131e896e176e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e9d0d0-fcb9-4e25-80cf-4af8770b5052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:20 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Volume 6cf1e8c2-877e-4099-95d6-b5e0278284ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef', 'volume_size': 1} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1614386643',display_name='tempest-VolumesGetTest-Volume-1232285089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf1e8c2-877e-4099-95d6-b5e0278284ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:20Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Creating volume 6cf1e8c2-877e-4099-95d6-b5e0278284ef {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:20 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:20 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-910cae47-dacf-4ee0-94e5-489f0f365c4d" returned: 0 in 0.256s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:20 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef 1073741824 Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-910cae47-dacf-4ee0-94e5-489f0f365c4d" released by "delete_volume" :: held 0.709s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:20 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Created reservations ['925cf03b-d926-4c52-acb1-36ef6f4bf003', '520579d1-a7f6-40e1-9c18-b42c35a3793a', '808a58d9-06c1-432f-a63f-1191fab2a6a3', '9aee59f3-4e2d-4ed4-a970-24b50fd5aa88'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:20 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:20 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-cbed7013-b956-4793-94e9-62d27323948b-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:20 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-cbed7013-b956-4793-94e9-62d27323948b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:20 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Deleted volume successfully. Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c6197a7a-2702-4a83-b32e-404e542b8aeb tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-910cae47-dacf-4ee0-94e5-489f0f365c4d-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-quobyte-cbed7013-b956-4793-94e9-62d27323948b" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-cbed7013-b956-4793-94e9-62d27323948b" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bdb61d-f672-4e71-8035-fc2e1f40ba15]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:21 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef 1073741824" returned: 0 in 0.623s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:21 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef Jul 24 12:51:21 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:21 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b Jul 24 12:51:21 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:21 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef" returned: 0 in 0.259s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44e9d0d0-fcb9-4e25-80cf-4af8770b5052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79606df9-647d-419f-819b-ea39cf00d802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:21 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Volume volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef (6cf1e8c2-877e-4099-95d6-b5e0278284ef): created successfully Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79606df9-647d-419f-819b-ea39cf00d802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (06f14867-bd2b-4556-a20f-434404ef4f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2a847f25-846f-4034-b9dc-102fec416ad1 tempest-VolumesGetTest-441918362 None] Created volume successfully. Jul 24 12:51:21 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b" returned: 0 in 0.403s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:21 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b Jul 24 12:51:21 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:21 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-cbed7013-b956-4793-94e9-62d27323948b" returned: 0 in 0.257s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-cbed7013-b956-4793-94e9-62d27323948b" released by "delete_volume" :: held 0.706s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Created reservations ['be90e8d6-521a-49ce-886a-ad85f1012fd4', '73747d3d-777c-4fb8-81c7-6847f155ee1f', '3f81a3d5-f9d8-45d3-a538-cec94aab585b', 'dee64c39-8036-4908-9495-f1c4b867945c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:21 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:21 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:22 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.295s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:22 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Deleted volume successfully. Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ed0d2fc6-2ceb-4a84-9131-423cb06ecd2d tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-cbed7013-b956-4793-94e9-62d27323948b-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-quobyte-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9" acquired by "delete_volume" :: waited 0.018s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b2c34b-96ad-4944-9b1f-df77aa890aee]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:22 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 Jul 24 12:51:22 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-6cf1e8c2-877e-4099-95d6-b5e0278284ef-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Lock "cinder-6cf1e8c2-877e-4099-95d6-b5e0278284ef-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-quobyte-6cf1e8c2-877e-4099-95d6-b5e0278284ef" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-6cf1e8c2-877e-4099-95d6-b5e0278284ef" acquired by "delete_volume" :: waited 0.027s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:22 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9" returned: 0 in 0.436s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d201e4b1-bc1a-436a-8136-53d823b1d3f7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:22 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9 Jul 24 12:51:22 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:22 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef Jul 24 12:51:22 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:22 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9" returned: 0 in 0.249s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9" released by "delete_volume" :: held 0.750s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:22 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Created reservations ['665959d6-9ee2-4a26-b28b-e9a7fcd934b0', '8089ecb8-0a9d-4ef9-a6ae-28587d55b7f8', '95fab1a9-19fe-481b-928e-f4d59ed0206e', 'de66af6e-50cb-49db-a8e2-37d02a9e84c6'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:23 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef" returned: 0 in 0.402s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:23 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:23 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:23 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef Jul 24 12:51:23 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:23 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-89476ad2-e76a-440b-9eae-bdc305a72c4e-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:23 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.321s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6cf1e8c2-877e-4099-95d6-b5e0278284ef" returned: 0 in 0.327s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-89476ad2-e76a-440b-9eae-bdc305a72c4e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Deleted volume successfully. Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-6cf1e8c2-877e-4099-95d6-b5e0278284ef" released by "delete_volume" :: held 0.816s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-386ba1e1-73b7-4d37-b8e1-7640ad39ffa3 tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-9061e4ad-39c2-412a-a5e2-dc18bb8d91b9-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-quobyte-89476ad2-e76a-440b-9eae-bdc305a72c4e" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-89476ad2-e76a-440b-9eae-bdc305a72c4e" acquired by "delete_volume" :: waited 0.037s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Created reservations ['15050a62-b699-43b0-869c-82e4149f2ec6', 'e448d14b-d211-4800-bda5-34947000ea4c', 'e1fc54ae-504a-450c-8eb2-2953e636b454', '29e844a2-70d2-4a52-ad4a-bbabf5e1bcb1'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e8d6a5-a37d-453f-b079-368386ab7ad1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:23 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e Jul 24 12:51:23 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:23 devstack sudo[103761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:23 devstack sudo[103761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:24 devstack sudo[103761]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.273s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Deleted volume successfully. Jul 24 12:51:24 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a7c6c21b-261b-4e47-ad52-1169718c57e8 tempest-VolumesGetTest-441918362 None] Lock "cinder-6cf1e8c2-877e-4099-95d6-b5e0278284ef-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e" returned: 0 in 0.458s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:24 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e Jul 24 12:51:24 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:24 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-89476ad2-e76a-440b-9eae-bdc305a72c4e" returned: 0 in 0.250s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-89476ad2-e76a-440b-9eae-bdc305a72c4e" released by "delete_volume" :: held 0.764s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Created reservations ['c6322919-c548-479f-8b07-de0e715e5008', 'a2fdebb3-1b63-4f1a-92b4-6e1a9bc0812d', '8bd0786d-cd2f-4a1e-bcda-5b3b2feff063', '8d7c9a4a-a581-4b26-bf64-6dc67c388e72'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:24 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:24 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-5a4f2bf7-f105-4f4c-8148-425ea376ec4f-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-5a4f2bf7-f105-4f4c-8148-425ea376ec4f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "cinder-quobyte-5a4f2bf7-f105-4f4c-8148-425ea376ec4f" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-5a4f2bf7-f105-4f4c-8148-425ea376ec4f" acquired by "delete_volume" :: waited 0.018s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca20fdce-abc4-4485-885d-92fbd0928077]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:24 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.409s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Deleted volume successfully. Jul 24 12:51:24 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f Jul 24 12:51:24 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-41e6d63c-d831-4897-894a-b03628f1f583-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-355ad811-7945-4ac0-8542-0ecec9f5c08e tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-89476ad2-e76a-440b-9eae-bdc305a72c4e-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Lock "cinder-41e6d63c-d831-4897-894a-b03628f1f583-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-quobyte-41e6d63c-d831-4897-894a-b03628f1f583" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-41e6d63c-d831-4897-894a-b03628f1f583" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a4a601-7407-4408-bfee-67b5d8f9bd96]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:25 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 Jul 24 12:51:25 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:25 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f" returned: 0 in 0.528s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:25 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f Jul 24 12:51:25 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:25 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583" returned: 0 in 0.417s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:25 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583 Jul 24 12:51:25 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:25 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5a4f2bf7-f105-4f4c-8148-425ea376ec4f" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-quobyte-5a4f2bf7-f105-4f4c-8148-425ea376ec4f" released by "delete_volume" :: held 0.952s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Created reservations ['ad0adf5f-34f3-4f1f-921f-6e291c5fc4db', 'a0a02088-dd38-4ffb-8615-7baa58e27f43', '3dca4261-0af0-480b-aa1e-1f9ac76836bf', 'cd44d92c-cbe6-4a86-a54b-c9bf63cf1a13'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:25 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-41e6d63c-d831-4897-894a-b03628f1f583" returned: 0 in 0.314s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-41e6d63c-d831-4897-894a-b03628f1f583" released by "delete_volume" :: held 0.799s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:25 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:25 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:25 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Created reservations ['31d2b866-d9f3-489f-bce8-dc5ecc8644ae', 'ce79df3e-39c4-4b05-a5f1-b1b7a3e2a2cb', '24d0a2df-1b84-4879-a6aa-77fc8b8ae31b', 'fc502360-be00-4d55-964e-7c56e888d184'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:26 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:26 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:26 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.330s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Deleted volume successfully. Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-70170d85-9616-4048-9a89-bb529766b135-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d9aeb601-5a7d-4c4a-8a67-dd7640a175d5 tempest-CreateVolumesFromImageTest-434138548 None] Lock "cinder-5a4f2bf7-f105-4f4c-8148-425ea376ec4f-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Lock "cinder-70170d85-9616-4048-9a89-bb529766b135-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-quobyte-70170d85-9616-4048-9a89-bb529766b135" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:26 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-70170d85-9616-4048-9a89-bb529766b135" acquired by "delete_volume" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.417s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Deleted volume successfully. Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e680d03-69e0-450c-bb67-36a7fdd8e118]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5942160c-49ed-4624-8d43-3f43cd22df95 tempest-VolumesGetTest-441918362 None] Lock "cinder-41e6d63c-d831-4897-894a-b03628f1f583-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:26 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 Jul 24 12:51:26 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:26 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135" returned: 0 in 0.481s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:26 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135 Jul 24 12:51:26 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:27 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-70170d85-9616-4048-9a89-bb529766b135" returned: 0 in 0.270s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-70170d85-9616-4048-9a89-bb529766b135" released by "delete_volume" :: held 0.823s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Created reservations ['89ae8a70-a5c4-4e2e-aab7-6e8bffc2c3fb', '3d4516ea-640c-408e-b4ec-c017ff1a09e7', '0c65dff8-7f93-4447-89ad-8914dbfa93e7', '4435546f-fa66-4997-8d14-5b895a8a127a'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:27 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:27 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:27 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.422s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Deleted volume successfully. Jul 24 12:51:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9a733e93-10ad-402b-82f9-54e3c29d65bf tempest-VolumesGetTest-441918362 None] Lock "cinder-70170d85-9616-4048-9a89-bb529766b135-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (766e37b6-b0d1-4e83-8aba-a8d1809addc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdea99fa-187e-4bca-baaf-44c84f0372db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdea99fa-187e-4bca-baaf-44c84f0372db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1633648569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda0d6fc-26aa-4a7a-9f1c-a699adca7675,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:28Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1cf1f3b-0c69-41b0-aa78-8eb07dc07b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1cf1f3b-0c69-41b0-aa78-8eb07dc07b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d51d137-9af2-498b-8b76-63550897652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.image.glance [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Creating Keystone auth plugin from conf {{(pid=88540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d51d137-9af2-498b-8b76-63550897652b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dda0d6fc-26aa-4a7a-9f1c-a699adca7675', 'volume_name': 'volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e584a8a7-89fa-4393-9824-2669a7434311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e584a8a7-89fa-4393-9824-2669a7434311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf23a63-97c5-4944-b56f-8e1b84754956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:28 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Volume dda0d6fc-26aa-4a7a-9f1c-a699adca7675: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 12:51:28 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Trying to clone dda0d6fc-26aa-4a7a-9f1c-a699adca7675 from image b9bc6022-042c-4b2c-a61d-587b72521a75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]). {{(pid=88540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 12:51:29 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 12:51:29 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Image download 20.69 MB at 20.69 MB/s Jul 24 12:51:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1a86c0-a5c7-4605-bee4-24e88914a33a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:29 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD Jul 24 12:51:29 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:29 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:29 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Temporary image b9bc6022-042c-4b2c-a61d-587b72521a75 is fetched for user 257088454dab44b3912d0da3873056bb. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 12:51:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7a4355-7271-4af3-9f78-4e59547c20ab]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:30 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD Jul 24 12:51:30 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:30 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1633648569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda0d6fc-26aa-4a7a-9f1c-a699adca7675,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:28Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Creating volume dda0d6fc-26aa-4a7a-9f1c-a699adca7675 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:30 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:30 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 1073741824 Jul 24 12:51:30 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Flow 'volume_create_manager' (ae5d57b0-5a36-46bc-b99a-22e69518f363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00dd2356-b35b-4e6a-89a4-411d9aff6c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00dd2356-b35b-4e6a-89a4-411d9aff6c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e42c88-b80c-48a1-a15d-41ed7b73b9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3128c5a7fea848e48fe790cfe129a9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:31Z,use_quota=True,user_id='4d6252e027ef4b05816e09d122324fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1edfcf9-2ef8-43b4-96fd-5582ea06e867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1edfcf9-2ef8-43b4-96fd-5582ea06e867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679adcad-7fe7-44a3-b648-3fd017ee90b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679adcad-7fe7-44a3-b648-3fd017ee90b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e42c88-b80c-48a1-a15d-41ed7b73b9e1', 'volume_name': 'volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6913ca-6ed2-440b-8d73-e9d3e1e6786d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6913ca-6ed2-440b-8d73-e9d3e1e6786d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7507b87-ca27-41fe-b601-53524fe19046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:30 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Volume 98e42c88-b80c-48a1-a15d-41ed7b73b9e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1', 'volume_size': 1} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:30 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 1073741824" returned: 0 in 0.606s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:30 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 Jul 24 12:51:30 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:31 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675" returned: 0 in 0.256s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e42c88-b80c-48a1-a15d-41ed7b73b9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3128c5a7fea848e48fe790cfe129a9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:31Z,use_quota=True,user_id='4d6252e027ef4b05816e09d122324fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Creating volume 98e42c88-b80c-48a1-a15d-41ed7b73b9e1 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:31 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:31 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 1073741824 Jul 24 12:51:31 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Attempting download of b9bc6022-042c-4b2c-a61d-587b72521a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}])) to volume dda0d6fc-26aa-4a7a-9f1c-a699adca7675. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4657f613-5624-435e-a743-fd03ea868e58]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_2zeahqzy {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:31 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_2zeahqzy Jul 24 12:51:31 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:31 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_2zeahqzy" returned: 0 in 0.395s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_2zeahqzy {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:31 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 1073741824" returned: 0 in 0.499s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:31 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 Jul 24 12:51:31 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:31 devstack sudo[103844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_2zeahqzy Jul 24 12:51:31 devstack sudo[103844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:31 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1" returned: 0 in 0.269s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7507b87-ca27-41fe-b601-53524fe19046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b43868-4678-4c2d-909d-5c422257c54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:32 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Volume volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 (98e42c88-b80c-48a1-a15d-41ed7b73b9e1): created successfully Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b43868-4678-4c2d-909d-5c422257c54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Flow 'volume_create_manager' (ae5d57b0-5a36-46bc-b99a-22e69518f363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:32 devstack sudo[103844]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_2zeahqzy" returned: 1 in 0.377s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_2zeahqzy' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ce27b7-82ac-481f-a8cc-02f85551ab8b]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ed5dd0ea-49a9-4dd1-9918-4c4a6b279374 tempest-CinderUnicodeTest-305553279 None] Created volume successfully. Jul 24 12:51:32 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD Jul 24 12:51:32 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:32 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] b9bc6022-042c-4b2c-a61d-587b72521a75 was qcow2, converting to qcow2 {{(pid=88540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 12:51:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:32 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 Jul 24 12:51:32 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Flow 'volume_create_manager' (81190adf-2384-4099-9f01-8705b49b9088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979ed575-9743-4c5b-8a48-f3fd593a0df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979ed575-9743-4c5b-8a48-f3fd593a0df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1473595811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddcf3b4-7698-4f18-8d85-a3999fee7106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3128c5a7fea848e48fe790cfe129a9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:33Z,use_quota=True,user_id='4d6252e027ef4b05816e09d122324fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb06c44-853b-4c58-a181-9a782659e749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb06c44-853b-4c58-a181-9a782659e749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf08995-ac76-4cd8-9f94-90c80a7707b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbf08995-ac76-4cd8-9f94-90c80a7707b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ddcf3b4-7698-4f18-8d85-a3999fee7106', 'volume_name': 'volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2973dc8-6f09-428d-8b17-087eff7e2473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2973dc8-6f09-428d-8b17-087eff7e2473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bc3369-f6e9-4439-943d-51a173279201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:33 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Volume 5ddcf3b4-7698-4f18-8d85-a3999fee7106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106', 'volume_size': 1} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1473595811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ddcf3b4-7698-4f18-8d85-a3999fee7106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3128c5a7fea848e48fe790cfe129a9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:33Z,use_quota=True,user_id='4d6252e027ef4b05816e09d122324fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Creating volume 5ddcf3b4-7698-4f18-8d85-a3999fee7106 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:33 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:33 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 1073741824 Jul 24 12:51:33 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:34 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 1073741824" returned: 0 in 0.520s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:34 devstack sudo[103870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 Jul 24 12:51:34 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:34 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106" returned: 0 in 0.340s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65bc3369-f6e9-4439-943d-51a173279201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfd10ae-bae7-43a6-9571-f81d58e396e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:34 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Volume volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 (5ddcf3b4-7698-4f18-8d85-a3999fee7106): created successfully Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cfd10ae-bae7-43a6-9571-f81d58e396e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Flow 'volume_create_manager' (81190adf-2384-4099-9f01-8705b49b9088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:34 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0ec2e108-86b2-4522-97da-27ad71562d5c tempest-CinderUnicodeTest-305553279 None] Created volume successfully. Jul 24 12:51:34 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675" returned: 0 in 2.190s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_w7i3szbtdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:51:34 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Converted 112.00 MB image at 51.11 MB/s Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:34 devstack sudo[103873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 1G Jul 24 12:51:34 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:34 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 1G" returned: 0 in 0.366s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Downloaded image b9bc6022-042c-4b2c-a61d-587b72521a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}])) to volume dda0d6fc-26aa-4a7a-9f1c-a699adca7675 successfully. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Temporary image b9bc6022-042c-4b2c-a61d-587b72521a75 for user 257088454dab44b3912d0da3873056bb is deleted. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Marking volume dda0d6fc-26aa-4a7a-9f1c-a699adca7675 as bootable. {{(pid=88540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Copying metadata from image b9bc6022-042c-4b2c-a61d-587b72521a75 to dda0d6fc-26aa-4a7a-9f1c-a699adca7675. {{(pid=88540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 12:51:34 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Creating volume glance metadata for volume dda0d6fc-26aa-4a7a-9f1c-a699adca7675 backed by image b9bc6022-042c-4b2c-a61d-587b72521a75 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 12:51:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf23a63-97c5-4944-b56f-8e1b84754956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacc3084-8c29-4375-93cf-67cde3bd1744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:35 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Volume volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 (dda0d6fc-26aa-4a7a-9f1c-a699adca7675): created successfully Jul 24 12:51:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacc3084-8c29-4375-93cf-67cde3bd1744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (766e37b6-b0d1-4e83-8aba-a8d1809addc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:35 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-546276f6-487c-474a-a0e0-92850203af6c tempest-VolumesGetTest-441918362 None] Created volume successfully. Jul 24 12:51:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Creating offline snapshot 3fcf57b7-4254-4c12-961d-6a8403ee4f4e of volume 5ddcf3b4-7698-4f18-8d85-a3999fee7106 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:51:35 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db01131-7dec-4bbe-82ce-9351d92aa4a5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:35 devstack sudo[103878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 Jul 24 12:51:35 devstack sudo[103878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:36 devstack sudo[103878]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106" returned: 0 in 0.516s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:36 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e 1G Jul 24 12:51:36 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (eafcd908-bcb0-4729-be90-60a04b310e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:36 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b1fe51-6d60-4395-9b87-900c965b49c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e 1G" returned: 0 in 0.616s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:36 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e Jul 24 12:51:36 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b1fe51-6d60-4395-9b87-900c965b49c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-644279908',display_name='tempest-VolumesGetTest-Volume-201578839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdd1ddb-a981-41c0-bf94-9f444a4494af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:37Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fb38bc-4b53-4091-9e7e-e2058b4861cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94fb38bc-4b53-4091-9e7e-e2058b4861cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4c1841-ec25-475f-b4ec-61cf86ef7c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f4c1841-ec25-475f-b4ec-61cf86ef7c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bdd1ddb-a981-41c0-bf94-9f444a4494af', 'volume_name': 'volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581a74d4-aaae-4e85-8b86-d088f9b8b822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (581a74d4-aaae-4e85-8b86-d088f9b8b822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea40c3b6-845b-4524-b837-77093dd66e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:36 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Volume 5bdd1ddb-a981-41c0-bf94-9f444a4494af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af', 'volume_size': 1} Jul 24 12:51:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:37 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e" returned: 0 in 0.335s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:37 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e is being set with open permissions: ugo+rw Jul 24 12:51:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:37 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e Jul 24 12:51:37 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:37 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e" returned: 0 in 0.274s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:37 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.info Jul 24 12:51:37 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:37 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.info" returned: 0 in 0.362s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:37 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.info is being set with open permissions: ugo+rw Jul 24 12:51:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:37 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.info Jul 24 12:51:37 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:38 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.info" returned: 0 in 0.268s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.245s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-644279908',display_name='tempest-VolumesGetTest-Volume-201578839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdd1ddb-a981-41c0-bf94-9f444a4494af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9fb27f2f21d4533b573802ae0ded697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:37Z,use_quota=True,user_id='257088454dab44b3912d0da3873056bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Creating volume 5bdd1ddb-a981-41c0-bf94-9f444a4494af {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:38 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:38 devstack sudo[103903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af 1073741824 Jul 24 12:51:38 devstack sudo[103903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7e596f0e-dc90-4118-926d-75bfbf15b5f2 tempest-CinderUnicodeTest-305553279 None] Create snapshot completed successfully Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:38 devstack sudo[103903]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Flow 'volume_create_manager' (04950fe2-d971-4c37-9aec-6ba04ba4622d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9d5cf2-1148-48c1-978f-0aab20ff0d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af 1073741824" returned: 0 in 0.481s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9d5cf2-1148-48c1-978f-0aab20ff0d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1780932327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46712178-fbce-4a96-9915-fdbde670162d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6130b3bf93344352821785a2d8b39546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:39Z,use_quota=True,user_id='fc8f958447564985922ebd981049c1a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a806d88-105d-4a6e-bbab-8e365b9a2640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a806d88-105d-4a6e-bbab-8e365b9a2640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7656f71-db78-4bf9-acf0-387016044f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7656f71-db78-4bf9-acf0-387016044f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46712178-fbce-4a96-9915-fdbde670162d', 'volume_name': 'volume-46712178-fbce-4a96-9915-fdbde670162d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e538f4-022d-4151-b879-9102e06887ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5e538f4-022d-4151-b879-9102e06887ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586ba1df-918e-468f-9ebb-e70ab8c2d6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:38 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Volume 46712178-fbce-4a96-9915-fdbde670162d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46712178-fbce-4a96-9915-fdbde670162d', 'volume_size': 1} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:38 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af Jul 24 12:51:38 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Acquiring lock "cinder-3fcf57b7-4254-4c12-961d-6a8403ee4f4e-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Lock "cinder-3fcf57b7-4254-4c12-961d-6a8403ee4f4e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Acquiring lock "cinder-quobyte-5ddcf3b4-7698-4f18-8d85-a3999fee7106" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Lock "cinder-quobyte-5ddcf3b4-7698-4f18-8d85-a3999fee7106" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Acquiring lock "cinder-quobyte-3fcf57b7-4254-4c12-961d-6a8403ee4f4e" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Lock "cinder-quobyte-3fcf57b7-4254-4c12-961d-6a8403ee4f4e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Deleting offline snapshot 3fcf57b7-4254-4c12-961d-6a8403ee4f4e of volume 5ddcf3b4-7698-4f18-8d85-a3999fee7106 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] snapshot_file for this snap is: volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdc9fbb-56db-4ea5-afd7-abe186e7c915]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:39 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.289s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1780932327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46712178-fbce-4a96-9915-fdbde670162d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6130b3bf93344352821785a2d8b39546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:39Z,use_quota=True,user_id='fc8f958447564985922ebd981049c1a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Creating volume 46712178-fbce-4a96-9915-fdbde670162d {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:51:39 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea40c3b6-845b-4524-b837-77093dd66e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:39 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d 1073741824 Jul 24 12:51:39 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1c7a02-1e88-4a88-bb2d-1e5355429229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:39 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Volume volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af (5bdd1ddb-a981-41c0-bf94-9f444a4494af): created successfully Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce1c7a02-1e88-4a88-bb2d-1e5355429229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:39 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e Jul 24 12:51:39 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Flow 'volume_create_manager' (eafcd908-bcb0-4729-be90-60a04b310e43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7f0c33f2-aed0-45f0-b832-28a0feafe370 tempest-VolumesGetTest-441918362 None] Created volume successfully. Jul 24 12:51:39 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e" returned: 0 in 0.369s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5653ce-8eae-4aa9-9a42-98f7b2c191a1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:39 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d 1073741824" returned: 0 in 0.409s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:39 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 Jul 24 12:51:39 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:39 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d Jul 24 12:51:39 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:39 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:39 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106" returned: 0 in 0.373s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586ba1df-918e-468f-9ebb-e70ab8c2d6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46712178-fbce-4a96-9915-fdbde670162d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3698115-e7c1-454f-a469-157aad4dc92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:39 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e Jul 24 12:51:39 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:39 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Volume volume-46712178-fbce-4a96-9915-fdbde670162d (46712178-fbce-4a96-9915-fdbde670162d): created successfully Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3698115-e7c1-454f-a469-157aad4dc92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Flow 'volume_create_manager' (04950fe2-d971-4c37-9aec-6ba04ba4622d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1726741c-6d7e-4c0e-92a7-1e309aa5a157 tempest-TestImageHashVerification-1244733768 None] Created volume successfully. Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-5bdd1ddb-a981-41c0-bf94-9f444a4494af-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Lock "cinder-5bdd1ddb-a981-41c0-bf94-9f444a4494af-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-quobyte-5bdd1ddb-a981-41c0-bf94-9f444a4494af" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-5bdd1ddb-a981-41c0-bf94-9f444a4494af" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:40 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e" returned: 0 in 0.375s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3bb962-fd52-46bb-9614-dec774a2cd08]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:40 devstack sudo[103937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e Jul 24 12:51:40 devstack sudo[103937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:40 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af Jul 24 12:51:40 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:40 devstack sudo[103937]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106.3fcf57b7-4254-4c12-961d-6a8403ee4f4e" returned: 0 in 0.255s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Lock "cinder-quobyte-3fcf57b7-4254-4c12-961d-6a8403ee4f4e" released by "_delete_snapshot" :: held 1.470s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Lock "cinder-quobyte-5ddcf3b4-7698-4f18-8d85-a3999fee7106" released by "delete_snapshot" :: held 1.497s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Created reservations ['7ae4273c-573e-4ccb-83da-0f616ffd9118', '7a52f968-65a1-4a7e-a46b-e9742bb0ac6b', '43d68644-fd7f-4e70-bf19-1b9bfc9bc162', 'bded283f-0b8c-4b99-8ea1-42a2f6a65b3e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:40 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af" returned: 0 in 0.370s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:40 devstack sudo[103945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af Jul 24 12:51:40 devstack sudo[103945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:40 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Delete snapshot completed successfully. Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5b072a32-c06d-445d-b08b-fec7876290bd tempest-CinderUnicodeTest-305553279 None] Lock "cinder-3fcf57b7-4254-4c12-961d-6a8403ee4f4e-delete_snapshot" released by "delete_snapshot" :: held 1.665s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:40 devstack sudo[103945]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5bdd1ddb-a981-41c0-bf94-9f444a4494af" returned: 0 in 0.262s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-5bdd1ddb-a981-41c0-bf94-9f444a4494af" released by "delete_volume" :: held 0.676s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Created reservations ['6a107081-219b-4357-abe4-0c8f3cfaeaee', '0655e9a8-f6cf-45b6-b21f-660c46453b0b', '5a13873c-44e6-4b4b-bd49-769ca536a763', 'e0b4866a-5d76-47e0-b828-453c849fdee2'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:40 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:40 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Acquiring lock "cinder-5ddcf3b4-7698-4f18-8d85-a3999fee7106-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Lock "cinder-5ddcf3b4-7698-4f18-8d85-a3999fee7106-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Acquiring lock "cinder-quobyte-5ddcf3b4-7698-4f18-8d85-a3999fee7106" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Lock "cinder-quobyte-5ddcf3b4-7698-4f18-8d85-a3999fee7106" acquired by "delete_volume" :: waited 0.018s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:41 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.285s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Deleted volume successfully. Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd77a9c-5b9c-444f-aa29-62e94cadf23f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa3438b3-9da7-45ff-a199-0d6b8f3cd8ee tempest-VolumesGetTest-441918362 None] Lock "cinder-5bdd1ddb-a981-41c0-bf94-9f444a4494af-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-dda0d6fc-26aa-4a7a-9f1c-a699adca7675-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Lock "cinder-dda0d6fc-26aa-4a7a-9f1c-a699adca7675-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Acquiring lock "cinder-quobyte-dda0d6fc-26aa-4a7a-9f1c-a699adca7675" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:41 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-dda0d6fc-26aa-4a7a-9f1c-a699adca7675" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:41 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f345dca0-2ee7-459e-9bce-af3c80438fb0]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:41 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 Jul 24 12:51:41 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:41 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f0ee20-b1e7-40aa-b046-22594ae96526]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106" returned: 0 in 0.499s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:41 devstack sudo[103959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106 Jul 24 12:51:41 devstack sudo[103959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:41 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d Jul 24 12:51:41 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:41 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675" returned: 0 in 0.408s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:41 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675 Jul 24 12:51:41 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:42 devstack sudo[103959]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5ddcf3b4-7698-4f18-8d85-a3999fee7106" returned: 0 in 0.259s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Lock "cinder-quobyte-5ddcf3b4-7698-4f18-8d85-a3999fee7106" released by "delete_volume" :: held 0.844s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Created reservations ['84d3cfc5-3480-424e-88fc-ea37a1ab2ed9', 'f3db5efc-92b9-4f8c-9367-6c1bbe9ebbf5', '66c26542-f859-43a6-9e6a-a9e0e9392b2f', '856603a2-a39f-4a89-a983-79e60bc2b281'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:42 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-dda0d6fc-26aa-4a7a-9f1c-a699adca7675" returned: 0 in 0.268s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:42 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d" returned: 0 in 0.400s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Lock "cinder-quobyte-dda0d6fc-26aa-4a7a-9f1c-a699adca7675" released by "delete_volume" :: held 0.721s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d9ed80-26ba-4b7f-94ab-e322ac336233]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:42 devstack sudo[103973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:42 devstack sudo[103973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Acquiring lock "cinder-98e42c88-b80c-48a1-a15d-41ed7b73b9e1-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Created reservations ['787f544f-4cc1-47d1-9718-9f4e4ef43cd2', '5f25785c-3a5f-4c05-b132-2f21e1584362', '1d2bea2c-7df9-452c-a22e-3fa31ba30bc1', 'c3351160-9fcf-437f-97a5-9e7c477ef35d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:42 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:42 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Lock "cinder-98e42c88-b80c-48a1-a15d-41ed7b73b9e1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:42 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d Jul 24 12:51:42 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Acquiring lock "cinder-quobyte-98e42c88-b80c-48a1-a15d-41ed7b73b9e1" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Lock "cinder-quobyte-98e42c88-b80c-48a1-a15d-41ed7b73b9e1" acquired by "delete_volume" :: waited 0.039s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f90b418-d6dd-42bb-8174-2c5250d5d7a5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:42 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:42 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:42 devstack sudo[103973]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.395s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:51:42 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.402s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:42 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Deleted volume successfully. Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-25778483-2ec2-4f1e-af09-aa943c08e733 tempest-CinderUnicodeTest-305553279 None] Lock "cinder-5ddcf3b4-7698-4f18-8d85-a3999fee7106-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:42 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 Jul 24 12:51:42 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:42 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d" returned: 0 in 0.544s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d /opt/stack/data/cinder/conversion/46712178-fbce-4a96-9915-fdbde670162d.temp_image.c28d4344-a89a-4a59-aea0-18f0b92d0411qh1hu38o.img {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:42 devstack sudo[103988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d /opt/stack/data/cinder/conversion/46712178-fbce-4a96-9915-fdbde670162d.temp_image.c28d4344-a89a-4a59-aea0-18f0b92d0411qh1hu38o.img Jul 24 12:51:42 devstack sudo[103988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:42 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.343s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:42 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Deleted volume successfully. Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8185e084-ff49-4c41-a282-ea7e1c22cbec tempest-VolumesGetTest-441918362 None] Lock "cinder-dda0d6fc-26aa-4a7a-9f1c-a699adca7675-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:42 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1" returned: 0 in 0.525s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:43 devstack sudo[103994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1 Jul 24 12:51:43 devstack sudo[103994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:43 devstack sudo[103994]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98e42c88-b80c-48a1-a15d-41ed7b73b9e1" returned: 0 in 0.316s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Lock "cinder-quobyte-98e42c88-b80c-48a1-a15d-41ed7b73b9e1" released by "delete_volume" :: held 0.946s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:43 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Created reservations ['d2fc6a98-4a97-4b9d-bbad-7885f9beeb5d', '0e4715fe-eacb-4d23-8a25-1a18622c2de5', '9584ee98-44e6-4556-b4ea-430f1c44e538', 'd7721bf3-60d8-4197-b8d0-a903d35fb4a1'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:51:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:51:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:51:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:51:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:51:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:43 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:51:43 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:44 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.727s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:44 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:51:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Deleted volume successfully. Jul 24 12:51:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd28a69a-1e2c-4ca7-addd-7a2bd51a480f tempest-CinderUnicodeTest-305553279 None] Lock "cinder-98e42c88-b80c-48a1-a15d-41ed7b73b9e1-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:51:48 devstack sudo[103988]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d /opt/stack/data/cinder/conversion/46712178-fbce-4a96-9915-fdbde670162d.temp_image.c28d4344-a89a-4a59-aea0-18f0b92d0411qh1hu38o.img" returned: 0 in 5.304s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3120440-7de2-47c5-9f6f-d210961ddc6a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:51:48 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d Jul 24 12:51:48 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Flow 'volume_create_manager' (48ea4e0a-1c42-4a0b-a346-58a4b5b687d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ae43eb-487c-48a9-b407-ab2438b9f829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ae43eb-487c-48a9-b407-ab2438b9f829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-80729360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112d77dd-e773-4fbc-a798-12b79c27e7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee2f136dec74e6da760851692740a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:48Z,use_quota=True,user_id='ae89803caf684e219ede09ede702e9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c699fd3-c64d-42f7-80a7-b3799d07658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c699fd3-c64d-42f7-80a7-b3799d07658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1b0cc1-2875-4054-8772-90be1e2175aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a1b0cc1-2875-4054-8772-90be1e2175aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '112d77dd-e773-4fbc-a798-12b79c27e7bc', 'volume_name': 'volume-112d77dd-e773-4fbc-a798-12b79c27e7bc', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd759a7-b7ff-4ad2-b252-e8eb91f5c4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd759a7-b7ff-4ad2-b252-e8eb91f5c4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb6d4bc-26fe-47f4-8ebd-14b985b92267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:48 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Volume 112d77dd-e773-4fbc-a798-12b79c27e7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-112d77dd-e773-4fbc-a798-12b79c27e7bc', 'volume_size': 1} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:51:48 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d" returned: 0 in 0.533s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/conversion/46712178-fbce-4a96-9915-fdbde670162d.temp_image.c28d4344-a89a-4a59-aea0-18f0b92d0411qh1hu38o.img {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:51:48 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Converted 1024.00 MB image at 193.00 MB/s Jul 24 12:51:48 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] c28d4344-a89a-4a59-aea0-18f0b92d0411 was raw, no need to convert to raw {{(pid=88540) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Flow 'volume_create_manager' (ff01fba1-5be4-4015-add4-0c7989b627d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4233c98-58dd-46ca-8c66-d0bafcbdd13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4233c98-58dd-46ca-8c66-d0bafcbdd13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492128120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36a91627b304ce5a4b47c5d21ddc23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:50Z,use_quota=True,user_id='431d78a1a82d40c7836333ee77d18926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3e7c19-6219-4ab3-8f1a-a06ef7b335a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3e7c19-6219-4ab3-8f1a-a06ef7b335a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdff21d-fe7b-4f05-a6f3-8778079bb1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfdff21d-fe7b-4f05-a6f3-8778079bb1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb', 'volume_name': 'volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f3d9cf-3413-4ce0-8496-e2f6b26db130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f3d9cf-3413-4ce0-8496-e2f6b26db130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8ffa90-f421-4c3e-bfb9-943f0ee0a0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:51:50 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Volume 5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb', 'volume_size': 1} Jul 24 12:51:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:00 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=138,cinder:SELECT=92,cinder:DELETE=11,cinder:INSERT=38 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:52:00 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=123,cinder:SELECT=98,cinder:INSERT=37,cinder:DELETE=10 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:52:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.271s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Uploaded volume to glance image-id: c28d4344-a89a-4a59-aea0-18f0b92d0411. {{(pid=88540) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 12:52:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.643s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-80729360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=112d77dd-e773-4fbc-a798-12b79c27e7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cee2f136dec74e6da760851692740a7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:48Z,use_quota=True,user_id='ae89803caf684e219ede09ede702e9f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Creating volume 112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:07 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:07 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc 1073741824 Jul 24 12:52:07 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:07 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7840c82c-6d7c-4d6e-96cc-9de1abf6208d tempest-TestImageHashVerification-1244733768 None] Copy volume to image completed successfully. Jul 24 12:52:07 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc 1073741824" returned: 0 in 0.409s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:07 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc Jul 24 12:52:07 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:07 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc" returned: 0 in 0.243s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.214s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-492128120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36a91627b304ce5a4b47c5d21ddc23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:51:50Z,use_quota=True,user_id='431d78a1a82d40c7836333ee77d18926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Creating volume 5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:07 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:07 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb 1073741824 Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb6d4bc-26fe-47f4-8ebd-14b985b92267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-112d77dd-e773-4fbc-a798-12b79c27e7bc', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:07 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6a597f-34a8-42ec-aed9-bb7eb9394d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:07 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Volume volume-112d77dd-e773-4fbc-a798-12b79c27e7bc (112d77dd-e773-4fbc-a798-12b79c27e7bc): created successfully Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6a597f-34a8-42ec-aed9-bb7eb9394d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Flow 'volume_create_manager' (48ea4e0a-1c42-4a0b-a346-58a4b5b687d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:07 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-23be99b6-3e7b-4988-b830-2b2a794d1427 tempest-VolumesSnapshotListTestJSON-23732571 None] Created volume successfully. Jul 24 12:52:08 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb 1073741824" returned: 0 in 0.436s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:08 devstack sudo[104076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb Jul 24 12:52:08 devstack sudo[104076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Acquiring lock "cinder-46712178-fbce-4a96-9915-fdbde670162d-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Lock "cinder-46712178-fbce-4a96-9915-fdbde670162d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Acquiring lock "cinder-quobyte-46712178-fbce-4a96-9915-fdbde670162d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Lock "cinder-quobyte-46712178-fbce-4a96-9915-fdbde670162d" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[344c2e9e-c3e5-4bc1-be5c-5e9e218f8715]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:08 devstack sudo[104076]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb" returned: 0 in 0.269s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8ffa90-f421-4c3e-bfb9-943f0ee0a0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771d3fba-3913-4793-bd8f-aee9185b8bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:08 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Volume volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb (5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb): created successfully Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771d3fba-3913-4793-bd8f-aee9185b8bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Flow 'volume_create_manager' (ff01fba1-5be4-4015-add4-0c7989b627d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:08 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d Jul 24 12:52:08 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4f0f4651-ef94-41f2-8923-3aa17c0acffc tempest-ProjectReaderTests-859049382 None] Created volume successfully. Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Creating offline snapshot 8efb81a7-e26e-47c7-8309-59e5e5777cde of volume 112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc48a49-1c86-45e2-9ecd-9eea2b6307ad]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:08 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d" returned: 0 in 0.380s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:08 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d Jul 24 12:52:08 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:08 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc Jul 24 12:52:08 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:08 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-46712178-fbce-4a96-9915-fdbde670162d" returned: 0 in 0.254s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Lock "cinder-quobyte-46712178-fbce-4a96-9915-fdbde670162d" released by "delete_volume" :: held 0.682s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:09 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Created reservations ['97247275-24d0-44bb-8b75-243337fd6879', '1f696158-7b6e-4f1e-a201-8ccd9c11c734', 'bdef31f1-6e78-4c32-8bac-d870d38b9015', '1cfdf910-5015-4d0e-b43d-0efda76737d1'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc" returned: 0 in 0.366s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:09 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde 1G Jul 24 12:52:09 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:09 devstack sudo[104095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:09 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:09 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.259s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:09 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Deleted volume successfully. Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d570096e-6ede-4148-bead-b413c9fdb4fb tempest-TestImageHashVerification-1244733768 None] Lock "cinder-46712178-fbce-4a96-9915-fdbde670162d-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:09 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde 1G" returned: 0 in 0.419s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112d77dd-e773-4fbc-a798-12b79c27e7bc -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:09 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112d77dd-e773-4fbc-a798-12b79c27e7bc -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde Jul 24 12:52:09 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Acquiring lock "cinder-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:09 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112d77dd-e773-4fbc-a798-12b79c27e7bc -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde" returned: 0 in 0.304s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:09 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde is being set with open permissions: ugo+rw Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Lock "cinder-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:09 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde Jul 24 12:52:09 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Acquiring lock "cinder-quobyte-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Lock "cinder-quobyte-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9f78e-8733-4a91-9d7b-194e739d6d85]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:10 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb Jul 24 12:52:10 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:10 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:10 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.info Jul 24 12:52:10 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:10 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:10 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb" returned: 0 in 0.449s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.info" returned: 0 in 0.280s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:10 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.info is being set with open permissions: ugo+rw Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:10 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb Jul 24 12:52:10 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:10 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.info Jul 24 12:52:10 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:10 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb" returned: 0 in 0.260s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Lock "cinder-quobyte-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb" released by "delete_volume" :: held 0.769s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:10 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.info" returned: 0 in 0.283s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a08f586e-a891-4bcf-bfc5-eec71e9a60b8 tempest-VolumesSnapshotListTestJSON-23732571 None] Create snapshot completed successfully Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Created reservations ['630b1b1f-e413-4b12-b061-56c547ff7690', '36e21db8-ec7a-4363-82b2-f86347005821', '8a377dd7-bedb-42d3-8dc8-50d9af63b87d', '52ca6137-4077-464e-a77a-572e41609456'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:10 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:10 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:11 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.274s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:11 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Deleted volume successfully. Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dbc2b1bf-3ad4-46b9-8d97-f158486dfb39 tempest-ProjectReaderTests-859049382 None] Lock "cinder-5b68a6d4-0bb0-473e-9aea-f2bd13ed94eb-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Flow 'volume_create_manager' (a04f95d5-0ae9-450e-85a6-7902388b5f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc39fa8a-ff02-44f9-b9b7-a89d9fc26acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc39fa8a-ff02-44f9-b9b7-a89d9fc26acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1289475116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef77c916-930e-47a8-8442-fba4fc728333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36a91627b304ce5a4b47c5d21ddc23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:11Z,use_quota=True,user_id='431d78a1a82d40c7836333ee77d18926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35dadd33-c649-4abd-95d1-ecf7d0108714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35dadd33-c649-4abd-95d1-ecf7d0108714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ba041f-b219-466d-ae7a-8af4c17fcd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ba041f-b219-466d-ae7a-8af4c17fcd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef77c916-930e-47a8-8442-fba4fc728333', 'volume_name': 'volume-ef77c916-930e-47a8-8442-fba4fc728333', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e45fe5-8664-4499-b63b-084d9c325d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e45fe5-8664-4499-b63b-084d9c325d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bada075-65fb-4f38-aec1-5f73299f2761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:11 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Volume ef77c916-930e-47a8-8442-fba4fc728333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef77c916-930e-47a8-8442-fba4fc728333', 'volume_size': 1} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1289475116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef77c916-930e-47a8-8442-fba4fc728333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a36a91627b304ce5a4b47c5d21ddc23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:11Z,use_quota=True,user_id='431d78a1a82d40c7836333ee77d18926',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Creating volume ef77c916-930e-47a8-8442-fba4fc728333 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:11 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:11 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333 1073741824 Jul 24 12:52:11 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:12 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333 1073741824" returned: 0 in 0.533s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:12 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333 Jul 24 12:52:12 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:12 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333" returned: 0 in 0.275s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.360s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bada075-65fb-4f38-aec1-5f73299f2761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef77c916-930e-47a8-8442-fba4fc728333', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8465eddb-89da-48eb-9019-3a0940d235c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Creating offline snapshot 3c526fec-59f1-4fe1-a4c2-221900108287 of volume 112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:52:12 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Volume volume-ef77c916-930e-47a8-8442-fba4fc728333 (ef77c916-930e-47a8-8442-fba4fc728333): created successfully Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8465eddb-89da-48eb-9019-3a0940d235c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Flow 'volume_create_manager' (a04f95d5-0ae9-450e-85a6-7902388b5f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c3266c-cc8b-4e4b-b05e-ccfda747e1e1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c00fe0fb-ebc0-4ba5-b150-9dade7e65dde tempest-ProjectReaderTests-859049382 None] Created volume successfully. Jul 24 12:52:12 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde Jul 24 12:52:12 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:12 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde" returned: 0 in 0.383s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112d77dd-e773-4fbc-a798-12b79c27e7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:52:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:12 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 1G Jul 24 12:52:12 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:13 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 1G" returned: 0 in 0.452s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:13 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 Jul 24 12:52:13 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Acquiring lock "cinder-ef77c916-930e-47a8-8442-fba4fc728333-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Lock "cinder-ef77c916-930e-47a8-8442-fba4fc728333-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Acquiring lock "cinder-quobyte-ef77c916-930e-47a8-8442-fba4fc728333" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:13 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287" returned: 0 in 0.348s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:13 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 is being set with open permissions: ugo+rw Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Lock "cinder-quobyte-ef77c916-930e-47a8-8442-fba4fc728333" acquired by "delete_volume" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:13 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 Jul 24 12:52:13 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b00b16-14fa-4e54-a44f-bf9b919eb59c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:13 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333 Jul 24 12:52:13 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:13 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287" returned: 0 in 0.262s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.586s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ffe57943-81af-46fd-b264-b0b5710dd4c7 tempest-VolumesSnapshotListTestJSON-23732571 None] Create snapshot completed successfully Jul 24 12:52:14 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333" returned: 0 in 0.405s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:14 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333 Jul 24 12:52:14 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Creating offline snapshot 55b047c6-3cb5-4692-9508-156a0add24d1 of volume 112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6eabf0-15d3-404d-81b6-47edd6a25f1f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:14 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ef77c916-930e-47a8-8442-fba4fc728333" returned: 0 in 0.326s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Lock "cinder-quobyte-ef77c916-930e-47a8-8442-fba4fc728333" released by "delete_volume" :: held 0.790s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:14 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 Jul 24 12:52:14 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Created reservations ['35f148e7-98fe-4e90-b398-31905c3a8b88', 'cf54020c-ca0f-4384-962a-ea5eb3b20ccc', '887d090f-14d5-4866-bff3-04fe3179a31d', 'a3daee0f-326a-4705-890f-713c030444d3'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:14 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:14 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:14 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287" returned: 0 in 0.450s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112d77dd-e773-4fbc-a798-12b79c27e7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:14 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 1G Jul 24 12:52:14 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:14 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.347s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:14 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Deleted volume successfully. Jul 24 12:52:15 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-44bbbe49-b4ad-4b0c-9069-6220803be036 tempest-ProjectReaderTests-859049382 None] Lock "cinder-ef77c916-930e-47a8-8442-fba4fc728333-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:15 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 1G" returned: 0 in 0.589s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:15 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 Jul 24 12:52:15 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:15 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:15 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 is being set with open permissions: ugo+rw Jul 24 12:52:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:15 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 Jul 24 12:52:15 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:16 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1" returned: 0 in 0.333s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:16 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-330d8a1e-f88f-4802-8e85-7d24d87d926b tempest-VolumesSnapshotListTestJSON-23732571 None] Create snapshot completed successfully Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-55b047c6-3cb5-4692-9508-156a0add24d1-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-55b047c6-3cb5-4692-9508-156a0add24d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-quobyte-55b047c6-3cb5-4692-9508-156a0add24d1" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-55b047c6-3cb5-4692-9508-156a0add24d1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Deleting offline snapshot 55b047c6-3cb5-4692-9508-156a0add24d1 of volume 112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] snapshot_file for this snap is: volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b68191-a69d-4a71-8d7c-0f1243311868]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:17 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 Jul 24 12:52:17 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:17 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1" returned: 0 in 0.411s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112d77dd-e773-4fbc-a798-12b79c27e7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[309cef4e-6384-4de1-b85e-25b92941954d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:18 devstack sudo[104198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 Jul 24 12:52:18 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:18 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287" returned: 0 in 0.395s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112d77dd-e773-4fbc-a798-12b79c27e7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:52:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:18 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 Jul 24 12:52:18 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:18 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1" returned: 0 in 0.448s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:18 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1 Jul 24 12:52:18 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:19 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.55b047c6-3cb5-4692-9508-156a0add24d1" returned: 0 in 0.286s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-55b047c6-3cb5-4692-9508-156a0add24d1" released by "_delete_snapshot" :: held 1.661s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" released by "delete_snapshot" :: held 1.687s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Created reservations ['6a12eea6-ef66-4d3d-8578-30348d5d168b', 'c553c9d1-1b76-4e6d-9040-7cd2b41b76de', 'ccdcff2a-3343-4659-8d2d-61f9564a652d', '03e3e4e0-ed6d-485e-9349-589c1f7f1fd4'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Delete snapshot completed successfully. Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d69dd1ce-a154-439e-b18e-d9aa71a1ac1d tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-55b047c6-3cb5-4692-9508-156a0add24d1-delete_snapshot" released by "delete_snapshot" :: held 1.854s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-3c526fec-59f1-4fe1-a4c2-221900108287-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-3c526fec-59f1-4fe1-a4c2-221900108287-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-quobyte-3c526fec-59f1-4fe1-a4c2-221900108287" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-3c526fec-59f1-4fe1-a4c2-221900108287" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Deleting offline snapshot 3c526fec-59f1-4fe1-a4c2-221900108287 of volume 112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] snapshot_file for this snap is: volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Flow 'volume_create_manager' (1f0940b9-f8be-4eff-9c1f-cf524236be51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91adfe13-7200-453c-b222-10d50bc7c636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e25754e-c826-4679-b878-4e9db048ca91]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91adfe13-7200-453c-b222-10d50bc7c636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075303320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716335738b949f9ab292bc497da8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:20Z,use_quota=True,user_id='5843ed717027438dae5dc73ca8fd9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6d6f86-a5db-4298-acfb-89fc765cd492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb6d6f86-a5db-4298-acfb-89fc765cd492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5e3389-fa7e-4545-93d6-6bfb083d82c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f5e3389-fa7e-4545-93d6-6bfb083d82c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2', 'volume_name': 'volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac512fd-03c0-4ae1-bed1-d1e006511c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eac512fd-03c0-4ae1-bed1-d1e006511c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9540f0a-3a55-4a0e-9db4-2312f732a79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Volume 8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2', 'volume_size': 1} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075303320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716335738b949f9ab292bc497da8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:20Z,use_quota=True,user_id='5843ed717027438dae5dc73ca8fd9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Creating volume 8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:19 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:19 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 1073741824 Jul 24 12:52:19 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:19 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 Jul 24 12:52:19 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:20 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287" returned: 0 in 0.382s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112d77dd-e773-4fbc-a798-12b79c27e7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e19e99-a780-456b-b55d-e235aaf245bd]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:20 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 1073741824" returned: 0 in 0.482s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:20 devstack sudo[104225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde Jul 24 12:52:20 devstack sudo[104225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:20 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 Jul 24 12:52:20 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (e5ecca2a-da40-4e4e-9881-1315c167b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcc5842-06e8-4d3c-9d62-7e44e8d81c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dcc5842-06e8-4d3c-9d62-7e44e8d81c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1347897923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412d3764-aa4d-4c5e-a881-ccd62ab0b065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:20Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb5df1c-e5a2-4614-9fcf-0c1276d6c9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb5df1c-e5a2-4614-9fcf-0c1276d6c9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16fdcb9-c825-401a-bd7d-a8a439f69e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16fdcb9-c825-401a-bd7d-a8a439f69e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412d3764-aa4d-4c5e-a881-ccd62ab0b065', 'volume_name': 'volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26305ec2-6e4f-4356-9092-c222614e5500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26305ec2-6e4f-4356-9092-c222614e5500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bdb027-3e6b-46e6-9813-7e7432609c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:20 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume 412d3764-aa4d-4c5e-a881-ccd62ab0b065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065', 'volume_size': 1} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:20 devstack sudo[104225]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde" returned: 0 in 0.411s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112d77dd-e773-4fbc-a798-12b79c27e7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:20 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 Jul 24 12:52:20 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:20 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.135s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1347897923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412d3764-aa4d-4c5e-a881-ccd62ab0b065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:20Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Creating volume 412d3764-aa4d-4c5e-a881-ccd62ab0b065 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:20 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:20 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 1073741824 Jul 24 12:52:20 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9540f0a-3a55-4a0e-9db4-2312f732a79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a52841-4ec3-4a05-bb11-16b05ac9ff06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:20 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Volume volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 (8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2): created successfully Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a52841-4ec3-4a05-bb11-16b05ac9ff06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Flow 'volume_create_manager' (1f0940b9-f8be-4eff-9c1f-cf524236be51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:20 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ffd3db53-e119-46b3-9398-aad7e60dd592 tempest-ProjectReaderTests-1760241933 None] Created volume successfully. Jul 24 12:52:20 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287" returned: 0 in 0.400s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:20 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287 Jul 24 12:52:20 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:21 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 1073741824" returned: 0 in 0.437s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:21 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 Jul 24 12:52:21 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:21 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.3c526fec-59f1-4fe1-a4c2-221900108287" returned: 0 in 0.249s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-3c526fec-59f1-4fe1-a4c2-221900108287" released by "_delete_snapshot" :: held 1.563s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" released by "delete_snapshot" :: held 1.595s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Created reservations ['827ee36b-59b1-49e8-8d0b-6515f51ac793', '0ffa3615-a63d-4608-adf7-1ba57b7103cf', 'd4e9eb81-5d52-456d-a8a1-cecfcb84887b', '4f42b76c-8dca-4fee-8a36-919098a2c6a5'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:21 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065" returned: 0 in 0.275s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Delete snapshot completed successfully. Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8bdb027-3e6b-46e6-9813-7e7432609c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14158fc7-dcb4-4af7-9b56-dd3adba00709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7874a660-a17a-4818-a121-59608ed2c81f tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-3c526fec-59f1-4fe1-a4c2-221900108287-delete_snapshot" released by "delete_snapshot" :: held 1.762s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:21 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 (412d3764-aa4d-4c5e-a881-ccd62ab0b065): created successfully Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14158fc7-dcb4-4af7-9b56-dd3adba00709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (e5ecca2a-da40-4e4e-9881-1315c167b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9d2911ac-ed32-48ef-8686-fa03d3ecdb19 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created volume successfully. Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-8efb81a7-e26e-47c7-8309-59e5e5777cde-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-8efb81a7-e26e-47c7-8309-59e5e5777cde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-quobyte-8efb81a7-e26e-47c7-8309-59e5e5777cde" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-8efb81a7-e26e-47c7-8309-59e5e5777cde" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Deleting offline snapshot 8efb81a7-e26e-47c7-8309-59e5e5777cde of volume 112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] snapshot_file for this snap is: volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "cinder-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[50791649-0f60-4938-93f3-9c6ef96efd8e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "cinder-quobyte-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-quobyte-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76771cc-750e-4f6c-ab92-f2bf5c207d86]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:21 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde Jul 24 12:52:21 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:22 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 Jul 24 12:52:22 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:22 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde" returned: 0 in 0.399s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-112d77dd-e773-4fbc-a798-12b79c27e7bc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7bde21-6e10-48dd-a4b3-52af9265975d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:22 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2" returned: 0 in 0.385s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:22 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2 Jul 24 12:52:22 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:22 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc Jul 24 12:52:22 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:22 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2" returned: 0 in 0.251s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-quobyte-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2" released by "delete_volume" :: held 0.690s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:22 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc" returned: 0 in 0.403s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:22 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde Jul 24 12:52:22 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Created reservations ['465e422c-052b-42cc-8f5e-f7ab4e99bf30', 'c5d3d1f3-a11e-4ef9-9cdb-8485bf7521ab', 'd489913d-a53c-48c7-ac3f-c66e3297340e', 'c94534bf-43a8-42b3-a03b-7fc05df67fae'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:22 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:22 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:22 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (76f265f5-9805-4e94-b7ff-3be2741e74fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4275313-29c1-4060-9425-9f4fb3ea050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4275313-29c1-4060-9425-9f4fb3ea050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133106195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af37211-4c79-4009-9209-618b98e862e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:23Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68e433b-d865-4adc-8d6d-51ccb420f399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68e433b-d865-4adc-8d6d-51ccb420f399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e23f0b-b190-4d89-9dc6-4ecb050796b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4e23f0b-b190-4d89-9dc6-4ecb050796b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af37211-4c79-4009-9209-618b98e862e8', 'volume_name': 'volume-1af37211-4c79-4009-9209-618b98e862e8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f677f9a3-cf32-4958-b9ef-e0f373ed09e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f677f9a3-cf32-4958-b9ef-e0f373ed09e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa5cbb5-b8bf-40db-aba0-8903c73a7aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume 1af37211-4c79-4009-9209-618b98e862e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af37211-4c79-4009-9209-618b98e862e8', 'volume_size': 1} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-133106195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af37211-4c79-4009-9209-618b98e862e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:23Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Creating volume 1af37211-4c79-4009-9209-618b98e862e8 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:23 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:23 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.301s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:23 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8 1073741824 Jul 24 12:52:23 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Deleted volume successfully. Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-80ad21af-6d1a-4b70-a9df-80ae147dd709 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-8b8bbb6c-1bc9-4639-aa2e-07fd44e45fb2-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:23 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde" returned: 0 in 0.537s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:23 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde Jul 24 12:52:23 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (4047829a-4745-4a84-9d66-6390857e5068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410de5ff-c156-4cea-a1ca-852764a9900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (410de5ff-c156-4cea-a1ca-852764a9900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1023440175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fe2acc-ed05-4d46-bb68-a912e8f383ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:23Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ed3a4b-3505-415b-99da-690cae6df0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ed3a4b-3505-415b-99da-690cae6df0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef70fdb-f0f2-4a1a-931c-34dc7dd24a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ef70fdb-f0f2-4a1a-931c-34dc7dd24a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49fe2acc-ed05-4d46-bb68-a912e8f383ea', 'volume_name': 'volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a413ae-dfff-4ccd-b26a-0abc9f002d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a413ae-dfff-4ccd-b26a-0abc9f002d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886e6956-cc31-4322-941f-ecbee3843931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume 49fe2acc-ed05-4d46-bb68-a912e8f383ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea', 'volume_size': 1} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:23 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc.8efb81a7-e26e-47c7-8309-59e5e5777cde" returned: 0 in 0.424s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-8efb81a7-e26e-47c7-8309-59e5e5777cde" released by "_delete_snapshot" :: held 1.874s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" released by "delete_snapshot" :: held 1.896s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Created reservations ['413758c8-8a20-4cc9-85a1-dc9a113798cc', '112b8ff9-5e17-414d-8c8a-c22dbd16d5dc', '727823f6-b752-4300-a2b6-e94fc394714a', '7caeefcd-3cf1-429e-97f8-3c6f7d8800a0'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:23 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Flow 'volume_create_manager' (ea5b12ff-5d64-47ef-aed8-a12e0a5532f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5142d423-2e39-4674-90aa-6af85ffaf560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8 1073741824" returned: 0 in 0.722s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5142d423-2e39-4674-90aa-6af85ffaf560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126137172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f04e98a-3329-4ad0-afc4-5ca52ff500dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716335738b949f9ab292bc497da8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:24Z,use_quota=True,user_id='5843ed717027438dae5dc73ca8fd9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abdb553-1be1-4d4f-8668-95ea172f7dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9abdb553-1be1-4d4f-8668-95ea172f7dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0005f795-daa6-4754-b91b-45456b59dbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0005f795-daa6-4754-b91b-45456b59dbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f04e98a-3329-4ad0-afc4-5ca52ff500dc', 'volume_name': 'volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072dbdee-35fa-45b0-a070-76959cb6e012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (072dbdee-35fa-45b0-a070-76959cb6e012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0f77ea-fe6d-46c5-bf8f-fd67fbadbc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Volume 3f04e98a-3329-4ad0-afc4-5ca52ff500dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc', 'volume_size': 1} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:23 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8 Jul 24 12:52:23 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Delete snapshot completed successfully. Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (9fa01de9-8a4d-4e24-91e7-5931891c86d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a927330-45f6-4dd6-8756-35397d0ce628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1fb9e851-eb82-4c4d-b300-a09cb6db2146 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-8efb81a7-e26e-47c7-8309-59e5e5777cde-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a927330-45f6-4dd6-8756-35397d0ce628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-540270261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6ee656-6649-4617-a95e-bffa33a3bd7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:24Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf38b67-812e-4034-9637-523bee1d4509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf38b67-812e-4034-9637-523bee1d4509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fd0468-a5ec-4eb8-9f7f-a092edaff182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50fd0468-a5ec-4eb8-9f7f-a092edaff182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f6ee656-6649-4617-a95e-bffa33a3bd7c', 'volume_name': 'volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2c89b6-34cb-400a-950a-bbcba8eb5bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d2c89b6-34cb-400a-950a-bbcba8eb5bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a221fc38-27a8-45d1-a27e-1f10690f587f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume 9f6ee656-6649-4617-a95e-bffa33a3bd7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c', 'volume_size': 1} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:24 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1023440175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fe2acc-ed05-4d46-bb68-a912e8f383ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:23Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Creating volume 49fe2acc-ed05-4d46-bb68-a912e8f383ea {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:24 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa5cbb5-b8bf-40db-aba0-8903c73a7aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af37211-4c79-4009-9209-618b98e862e8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea 1073741824 Jul 24 12:52:24 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327c4450-50d3-44b6-bff5-5446a9754618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume volume-1af37211-4c79-4009-9209-618b98e862e8 (1af37211-4c79-4009-9209-618b98e862e8): created successfully Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327c4450-50d3-44b6-bff5-5446a9754618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (76f265f5-9805-4e94-b7ff-3be2741e74fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-601d1b06-2e6b-4fd2-aea7-6f9e5b38453e tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created volume successfully. Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (848f995c-4556-4208-8f93-10c257c2be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa70166-0d0f-4253-a258-38c0ae088201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fa70166-0d0f-4253-a258-38c0ae088201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138654101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48b3935-9cc2-4ee1-88f1-c66406bc2fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:24Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3842a868-37be-49a5-918f-2b1bd66be1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3842a868-37be-49a5-918f-2b1bd66be1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f77307-b1a0-4cb9-8c32-029959f57cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f77307-b1a0-4cb9-8c32-029959f57cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48b3935-9cc2-4ee1-88f1-c66406bc2fd0', 'volume_name': 'volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52924518-16d0-4900-aa6b-6a16e0c8cb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52924518-16d0-4900-aa6b-6a16e0c8cb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264578a8-e558-43c0-8647-96d71341f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume d48b3935-9cc2-4ee1-88f1-c66406bc2fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0', 'volume_size': 1} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:24 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea 1073741824" returned: 0 in 0.489s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (3d45270c-e9f6-484e-9b16-b4bcad0369e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de54c31-875a-4a27-9d01-329dc22320ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de54c31-875a-4a27-9d01-329dc22320ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847400728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256d0c18-da39-4404-a560-0d4dbb646f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:25Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a4c81d-8a31-4f27-b292-77ba5eeb6e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a4c81d-8a31-4f27-b292-77ba5eeb6e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1d5634-31a7-4097-98ef-330c14361291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1d5634-31a7-4097-98ef-330c14361291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256d0c18-da39-4404-a560-0d4dbb646f95', 'volume_name': 'volume-256d0c18-da39-4404-a560-0d4dbb646f95', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8602db9f-1a7f-44f2-a97d-96b9730acb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8602db9f-1a7f-44f2-a97d-96b9730acb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d324ff0-12b0-4142-aa18-cafe7703e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:24 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume 256d0c18-da39-4404-a560-0d4dbb646f95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256d0c18-da39-4404-a560-0d4dbb646f95', 'volume_size': 1} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:24 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea Jul 24 12:52:24 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-112d77dd-e773-4fbc-a798-12b79c27e7bc-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-112d77dd-e773-4fbc-a798-12b79c27e7bc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:25 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea" returned: 0 in 0.257s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2126137172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f04e98a-3329-4ad0-afc4-5ca52ff500dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716335738b949f9ab292bc497da8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:24Z,use_quota=True,user_id='5843ed717027438dae5dc73ca8fd9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Creating volume 3f04e98a-3329-4ad0-afc4-5ca52ff500dc {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:25 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:25 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc 1073741824 Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886e6956-cc31-4322-941f-ecbee3843931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:25 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c8a677-f600-401a-b15e-b582b2b96bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" acquired by "delete_volume" :: waited 0.035s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:25 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea (49fe2acc-ed05-4d46-bb68-a912e8f383ea): created successfully Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45c8a677-f600-401a-b15e-b582b2b96bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (4047829a-4745-4a84-9d66-6390857e5068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7677998-cdc1-4e8e-b73d-e402aba89be3]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d1861b58-2d29-4c01-be4e-ef1a546d1725 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created volume successfully. Jul 24 12:52:25 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc Jul 24 12:52:25 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:25 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc 1073741824" returned: 0 in 0.400s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:25 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc Jul 24 12:52:25 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:25 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc" returned: 0 in 0.372s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:25 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc Jul 24 12:52:25 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:25 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc" returned: 0 in 0.249s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.688s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-540270261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f6ee656-6649-4617-a95e-bffa33a3bd7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:24Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Creating volume 9f6ee656-6649-4617-a95e-bffa33a3bd7c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:25 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:25 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c 1073741824 Jul 24 12:52:25 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a0f77ea-fe6d-46c5-bf8f-fd67fbadbc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:25 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7b2094-5f07-4808-abba-724db2c4fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-112d77dd-e773-4fbc-a798-12b79c27e7bc" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-quobyte-112d77dd-e773-4fbc-a798-12b79c27e7bc" released by "delete_volume" :: held 0.712s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:25 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Volume volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc (3f04e98a-3329-4ad0-afc4-5ca52ff500dc): created successfully Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7b2094-5f07-4808-abba-724db2c4fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Flow 'volume_create_manager' (ea5b12ff-5d64-47ef-aed8-a12e0a5532f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-412bda42-18d1-41b6-856f-7d74d86b4d69 tempest-ProjectReaderTests-1760241933 None] Created volume successfully. Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Created reservations ['5470ccb3-e2a1-409a-9d9c-c16f96a52f19', '1c3bf1b8-2bfd-43f4-a60f-b373cde01126', '4e8b9432-3481-4594-9bbc-2c6ab37298dd', 'f7362d3a-e058-4d23-9597-21cae48d1209'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:25 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:25 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:26 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c 1073741824" returned: 0 in 0.446s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:26 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.268s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Deleted volume successfully. Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a2988c9b-b84e-4710-9693-8a2312815416 tempest-VolumesSnapshotListTestJSON-23732571 None] Lock "cinder-112d77dd-e773-4fbc-a798-12b79c27e7bc-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:26 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c Jul 24 12:52:26 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:26 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c" returned: 0 in 0.244s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.067s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-138654101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48b3935-9cc2-4ee1-88f1-c66406bc2fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:24Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Creating volume d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:26 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:26 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 1073741824 Jul 24 12:52:26 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a221fc38-27a8-45d1-a27e-1f10690f587f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f834fed9-2461-4964-9bfb-ef639fa63be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:26 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c (9f6ee656-6649-4617-a95e-bffa33a3bd7c): created successfully Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f834fed9-2461-4964-9bfb-ef639fa63be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (9fa01de9-8a4d-4e24-91e7-5931891c86d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-85958171-5020-41f5-b72f-aaa404a62421 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created volume successfully. Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "cinder-3f04e98a-3329-4ad0-afc4-5ca52ff500dc-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-3f04e98a-3329-4ad0-afc4-5ca52ff500dc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "cinder-quobyte-3f04e98a-3329-4ad0-afc4-5ca52ff500dc" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-quobyte-3f04e98a-3329-4ad0-afc4-5ca52ff500dc" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a13b1-1f42-4d27-a45b-aa109ea84c7d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:27 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 1073741824" returned: 0 in 0.547s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:27 devstack sudo[104336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 Jul 24 12:52:27 devstack sudo[104336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:27 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc Jul 24 12:52:27 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:27 devstack sudo[104336]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0" returned: 0 in 0.275s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1847400728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256d0c18-da39-4404-a560-0d4dbb646f95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54936a4043cd4b14bb2f727dd65b3f4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:25Z,use_quota=True,user_id='2b4596ddbb1e42018c29413f675c507d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Creating volume 256d0c18-da39-4404-a560-0d4dbb646f95 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:27 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264578a8-e558-43c0-8647-96d71341f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:27 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95 1073741824 Jul 24 12:52:27 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611eaef9-0f07-4d2f-a995-32508e09d89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:27 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 (d48b3935-9cc2-4ee1-88f1-c66406bc2fd0): created successfully Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611eaef9-0f07-4d2f-a995-32508e09d89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:27 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (848f995c-4556-4208-8f93-10c257c2be71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc" returned: 0 in 0.446s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2732912f-1106-4f59-b5be-d202d3d77cb7 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created volume successfully. Jul 24 12:52:27 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc Jul 24 12:52:27 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:27 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-3f04e98a-3329-4ad0-afc4-5ca52ff500dc" returned: 0 in 0.288s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-quobyte-3f04e98a-3329-4ad0-afc4-5ca52ff500dc" released by "delete_volume" :: held 0.790s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Created reservations ['9e077d9f-ab8d-43e8-b0e0-59fbd9d98fc8', '123f665d-c795-4f86-bbba-74fa00f0f4b0', 'ff29a2a7-89ab-4e5f-9720-858014b9b416', '221ea505-862b-4a55-98fa-9fb68c61ad2e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:27 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95 1073741824" returned: 0 in 0.536s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:27 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:27 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:27 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95 Jul 24 12:52:27 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:28 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.326s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Deleted volume successfully. Jul 24 12:52:28 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95" returned: 0 in 0.310s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d324ff0-12b0-4142-aa18-cafe7703e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256d0c18-da39-4404-a560-0d4dbb646f95', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b83442-ac98-4430-8e4a-97f8e8657d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-088d4d55-b14d-4fcb-8032-ce20ed770912 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-3f04e98a-3329-4ad0-afc4-5ca52ff500dc-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:28 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Volume volume-256d0c18-da39-4404-a560-0d4dbb646f95 (256d0c18-da39-4404-a560-0d4dbb646f95): created successfully Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13b83442-ac98-4430-8e4a-97f8e8657d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Flow 'volume_create_manager' (3d45270c-e9f6-484e-9b16-b4bcad0369e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-05646973-851f-449b-a979-fbc1d078ec68 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created volume successfully. Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Flow 'volume_create_manager' (7b7a8841-9413-49f0-a24f-db371d228ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fc6dd3-5848-46ce-bd1f-47330e1b48bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30fc6dd3-5848-46ce-bd1f-47330e1b48bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17743963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fc7fcb-28a8-45a5-b8c1-e38330031269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716335738b949f9ab292bc497da8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:29Z,use_quota=True,user_id='5843ed717027438dae5dc73ca8fd9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1c226c-051a-4fc4-af34-dad58344807a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1c226c-051a-4fc4-af34-dad58344807a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f458ae9-0b26-4119-be57-a3af768cdec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f458ae9-0b26-4119-be57-a3af768cdec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16fc7fcb-28a8-45a5-b8c1-e38330031269', 'volume_name': 'volume-16fc7fcb-28a8-45a5-b8c1-e38330031269', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa27067-16e1-4205-8ff1-24c9dbcf2e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa27067-16e1-4205-8ff1-24c9dbcf2e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57742de-5b99-4e54-9a2c-7b51a2bf68db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:28 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Volume 16fc7fcb-28a8-45a5-b8c1-e38330031269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16fc7fcb-28a8-45a5-b8c1-e38330031269', 'volume_size': 1} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-17743963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fc7fcb-28a8-45a5-b8c1-e38330031269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716335738b949f9ab292bc497da8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:29Z,use_quota=True,user_id='5843ed717027438dae5dc73ca8fd9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Creating volume 16fc7fcb-28a8-45a5-b8c1-e38330031269 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:28 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:28 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 1073741824 Jul 24 12:52:28 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:29 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 1073741824" returned: 0 in 0.455s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:29 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 Jul 24 12:52:29 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-256d0c18-da39-4404-a560-0d4dbb646f95-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-256d0c18-da39-4404-a560-0d4dbb646f95-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-quobyte-256d0c18-da39-4404-a560-0d4dbb646f95" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-256d0c18-da39-4404-a560-0d4dbb646f95" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f7336d-b44d-48ac-b11b-989ae676633d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:29 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:29 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95 Jul 24 12:52:29 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269" returned: 0 in 0.276s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57742de-5b99-4e54-9a2c-7b51a2bf68db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16fc7fcb-28a8-45a5-b8c1-e38330031269', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28890329-23ee-4082-94e3-87da358a8ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:29 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Volume volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 (16fc7fcb-28a8-45a5-b8c1-e38330031269): created successfully Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28890329-23ee-4082-94e3-87da358a8ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Flow 'volume_create_manager' (7b7a8841-9413-49f0-a24f-db371d228ed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ee00716f-7908-4001-ab30-68368dd4f7fc tempest-ProjectReaderTests-1760241933 None] Created volume successfully. Jul 24 12:52:29 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95" returned: 0 in 0.430s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:29 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95 Jul 24 12:52:29 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:30 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-256d0c18-da39-4404-a560-0d4dbb646f95" returned: 0 in 0.259s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-256d0c18-da39-4404-a560-0d4dbb646f95" released by "delete_volume" :: held 0.743s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created reservations ['1d7db942-bedc-463b-84cd-0a37f71868e0', 'df52462b-8a75-4fae-ab5d-9c7f5c7352f9', '7129fd15-8f65-4879-9728-b93290f8f609', 'b8105910-d61c-4393-ba28-2069b8450443'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:30 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:30 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:30 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.257s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Deleted volume successfully. Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-df4836cf-03ad-4a15-9aa7-05cbd7fea67c tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-256d0c18-da39-4404-a560-0d4dbb646f95-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-quobyte-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[353b292a-5a93-4c5c-9976-aae2378bf645]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:30 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 Jul 24 12:52:30 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "cinder-16fc7fcb-28a8-45a5-b8c1-e38330031269-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-16fc7fcb-28a8-45a5-b8c1-e38330031269-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "cinder-quobyte-16fc7fcb-28a8-45a5-b8c1-e38330031269" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-quobyte-16fc7fcb-28a8-45a5-b8c1-e38330031269" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0433401-cac5-4e3e-b20a-789dfb9aa005]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:30 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0" returned: 0 in 0.457s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:31 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 Jul 24 12:52:31 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0 Jul 24 12:52:31 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:31 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:31 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0" returned: 0 in 0.274s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0" released by "delete_volume" :: held 0.777s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:31 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269" returned: 0 in 0.403s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:31 devstack sudo[104394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269 Jul 24 12:52:31 devstack sudo[104394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created reservations ['7fdf04f2-0fab-47d5-955a-60da05f5d7fe', 'a15a5b63-128d-4566-87ca-8faf06e56ee2', 'e8311adf-9fdd-4123-83ef-26746b1bffe6', 'eaac48d6-346a-4e52-b814-5fb448026038'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:31 devstack sudo[104396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:31 devstack sudo[104396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:31 devstack sudo[104394]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-16fc7fcb-28a8-45a5-b8c1-e38330031269" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-quobyte-16fc7fcb-28a8-45a5-b8c1-e38330031269" released by "delete_volume" :: held 0.730s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-9f6ee656-6649-4617-a95e-bffa33a3bd7c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-9f6ee656-6649-4617-a95e-bffa33a3bd7c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Created reservations ['0e724129-414d-41c0-b4e2-f0a3f3240d1c', '5f118228-9a8e-4287-a060-ed8e8257bf5c', 'cd5cf185-acbd-4460-b2d0-f0805c34d038', 'c3deca76-fbc2-454a-af40-bad0b1f09e78'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-quobyte-9f6ee656-6649-4617-a95e-bffa33a3bd7c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-9f6ee656-6649-4617-a95e-bffa33a3bd7c" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffe7ab9-4368-4d14-af23-3208119708a5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:31 devstack sudo[104396]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.340s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:31 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Deleted volume successfully. Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-11a905f9-3734-4e5e-94ef-f84068edeafc tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-d48b3935-9cc2-4ee1-88f1-c66406bc2fd0-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:31 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:31 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:31 devstack sudo[104402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c Jul 24 12:52:31 devstack sudo[104402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:32 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.300s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Deleted volume successfully. Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4892d6de-7424-4134-a6e9-2e9024124183 tempest-ProjectReaderTests-1760241933 None] Lock "cinder-16fc7fcb-28a8-45a5-b8c1-e38330031269-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:32 devstack sudo[104402]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c" returned: 0 in 0.436s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:32 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c Jul 24 12:52:32 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Flow 'volume_create_manager' (50d913a5-84d1-4b1a-a4c6-6d834b7b0312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2abc13-a62b-4042-81bd-91744ae1b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2abc13-a62b-4042-81bd-91744ae1b180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951637386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716335738b949f9ab292bc497da8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:32Z,use_quota=True,user_id='5843ed717027438dae5dc73ca8fd9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775facdf-3500-40c5-a40f-b5fdc4d9a59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775facdf-3500-40c5-a40f-b5fdc4d9a59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:32 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57727886-1ada-4743-812e-0d9633725842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57727886-1ada-4743-812e-0d9633725842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897', 'volume_name': 'volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886f8f0e-b638-44ce-896c-a498a1a72fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886f8f0e-b638-44ce-896c-a498a1a72fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476b5314-928f-4413-9b8c-29255a87343a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:32 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Volume e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897', 'volume_size': 1} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-951637386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1716335738b949f9ab292bc497da8236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:32Z,use_quota=True,user_id='5843ed717027438dae5dc73ca8fd9b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Creating volume e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:32 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-9f6ee656-6649-4617-a95e-bffa33a3bd7c" returned: 0 in 0.403s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-9f6ee656-6649-4617-a95e-bffa33a3bd7c" released by "delete_volume" :: held 0.902s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:32 devstack sudo[104414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 1073741824 Jul 24 12:52:32 devstack sudo[104414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created reservations ['171fc52a-f7d8-4d73-afcd-8d4dca985d28', 'eae07caa-932c-4a88-ada0-c76a77c2b0f0', '633de84e-51dd-402b-b83c-1e390ad166ff', 'ecb3e239-31a3-448a-8c52-8eb8417c7934'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:32 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:32 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-49fe2acc-ed05-4d46-bb68-a912e8f383ea-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-49fe2acc-ed05-4d46-bb68-a912e8f383ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-quobyte-49fe2acc-ed05-4d46-bb68-a912e8f383ea" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-49fe2acc-ed05-4d46-bb68-a912e8f383ea" acquired by "delete_volume" :: waited 0.018s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[983cda41-5b8a-4107-9274-58995c2168a2]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:33 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.299s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:33 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Deleted volume successfully. Jul 24 12:52:33 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea Jul 24 12:52:33 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:33 devstack sudo[104414]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 1073741824" returned: 0 in 0.589s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6100f932-a150-425d-b8e9-3fa9994160ad tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-9f6ee656-6649-4617-a95e-bffa33a3bd7c-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:33 devstack sudo[104425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 Jul 24 12:52:33 devstack sudo[104425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:33 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea" returned: 0 in 0.431s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:33 devstack sudo[104425]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:33 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea Jul 24 12:52:33 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (476b5314-928f-4413-9b8c-29255a87343a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138dbc0d-de50-45c3-8cc9-139b77ce0553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:33 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Volume volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 (e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897): created successfully Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (138dbc0d-de50-45c3-8cc9-139b77ce0553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Flow 'volume_create_manager' (50d913a5-84d1-4b1a-a4c6-6d834b7b0312) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:33 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3d521983-9759-4099-ad33-e9266e25a524 tempest-ProjectReaderTests-1760241933 None] Created volume successfully. Jul 24 12:52:33 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-49fe2acc-ed05-4d46-bb68-a912e8f383ea" returned: 0 in 0.342s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-49fe2acc-ed05-4d46-bb68-a912e8f383ea" released by "delete_volume" :: held 0.820s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created reservations ['54502be8-66d8-4c84-9e60-1c6cf2687f6a', '9bf7355c-9c6a-4660-8b6e-9b6e5f127a13', '7f82e6e8-bc98-40d7-8b75-0c4f16ff565b', '4cda0f9f-c53a-4e6c-9e7a-9de7eec758e5'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:33 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:33 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-1af37211-4c79-4009-9209-618b98e862e8-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-1af37211-4c79-4009-9209-618b98e862e8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-quobyte-1af37211-4c79-4009-9209-618b98e862e8" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-1af37211-4c79-4009-9209-618b98e862e8" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebaa929-1e06-4aa9-91ad-ba15bc7b87a3]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:34 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.274s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:34 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Deleted volume successfully. Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c194a3bb-2c29-4da4-b71e-e50a5214808a tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-49fe2acc-ed05-4d46-bb68-a912e8f383ea-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:34 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8 Jul 24 12:52:34 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Acquiring lock "cinder-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Lock "cinder-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:34 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8" returned: 0 in 0.447s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Acquiring lock "cinder-quobyte-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:34 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8 Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Lock "cinder-quobyte-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:34 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[28408199-3bd8-4a4c-a15c-e429704f6f4c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:34 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 Jul 24 12:52:34 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:34 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1af37211-4c79-4009-9209-618b98e862e8" returned: 0 in 0.293s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-1af37211-4c79-4009-9209-618b98e862e8" released by "delete_volume" :: held 0.794s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created reservations ['d9fd5c78-a6ba-4de6-a639-6b12c9b311f2', '70901721-f8d9-42c4-8c8c-43109b5da228', 'f658b8a2-0289-4727-adaf-32c2d1dd088c', 'fd0692d7-11f1-4dea-a8dd-0b256f7ad5ff'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:35 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897" returned: 0 in 0.407s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:35 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:35 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:35 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897 Jul 24 12:52:35 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-412d3764-aa4d-4c5e-a881-ccd62ab0b065-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-412d3764-aa4d-4c5e-a881-ccd62ab0b065-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "cinder-quobyte-412d3764-aa4d-4c5e-a881-ccd62ab0b065" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:52:35 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.333s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-412d3764-aa4d-4c5e-a881-ccd62ab0b065" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:52:35 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Deleted volume successfully. Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f147a0-6557-403d-abed-555627ec853e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:35 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c12a94bd-4cea-43fa-b9df-6348f8915ea1 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-1af37211-4c79-4009-9209-618b98e862e8-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897" returned: 0 in 0.373s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Lock "cinder-quobyte-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897" released by "delete_volume" :: held 0.828s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Created reservations ['0612f859-4181-4554-91b5-0b38b00368a6', 'fa80f457-6979-490d-8606-000ed6e3f720', '207dc76d-9125-43fa-a29e-27d487e67d67', '3bd92655-72ea-49e9-845b-71bd4a29f544'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:35 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 Jul 24 12:52:35 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:35 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:35 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:35 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065" returned: 0 in 0.520s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:36 devstack sudo[104466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065 Jul 24 12:52:36 devstack sudo[104466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:36 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.383s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Deleted volume successfully. Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa6c3120-73a1-46b4-8534-a557ca6d155e tempest-ProjectReaderTests-1760241933 None] Lock "cinder-e0a6d8ae-0e0e-4ebb-9b11-1dc9cbc55897-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:36 devstack sudo[104466]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-412d3764-aa4d-4c5e-a881-ccd62ab0b065" returned: 0 in 0.334s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-quobyte-412d3764-aa4d-4c5e-a881-ccd62ab0b065" released by "delete_volume" :: held 0.911s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Created reservations ['92184a96-d754-4bec-9b99-f8a7405d5e40', '4bff3339-1925-4f28-b936-1a3b903da808', 'f9225768-dbe1-4298-a657-922107f43924', '3f1364e6-fd4b-4ba1-8a23-c5bc58671f8f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:36 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:36 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:36 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.322s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Deleted volume successfully. Jul 24 12:52:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbff3676-6eeb-4a7c-99dd-1e3ea75e1280 tempest-CreateVolumesFromSourceVolumeTest-1834912471 None] Lock "cinder-412d3764-aa4d-4c5e-a881-ccd62ab0b065-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:42 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:52:42 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:42 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.253s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:52:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:52:46 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=175,cinder:SELECT=115,cinder:DELETE=17,cinder:INSERT=36 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:52:46 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=120,cinder:UPDATE=166,cinder:INSERT=46,cinder:DELETE=13 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Flow 'volume_create_manager' (a3d82a9c-a07e-493b-a1ce-f754babeedab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf36bacf-0bb4-4c48-b215-b82a6b5b4460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf36bacf-0bb4-4c48-b215-b82a6b5b4460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-31550702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401f1914-438c-47b3-9c6d-d40287f5b254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576d8f77b49b447991b3f3d8a419e533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:53Z,use_quota=True,user_id='ad8a2a7b577b4944bf7f336ed5a6c49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dc7c28e-b324-442c-88b2-9ca2786e1e39),volume_type_id=1dc7c28e-b324-442c-88b2-9ca2786e1e39)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ca6548-f34e-4efe-87ce-f6ee65afdfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ca6548-f34e-4efe-87ce-f6ee65afdfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007afd3d-c1f7-467d-b5a1-f8e3bf780f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007afd3d-c1f7-467d-b5a1-f8e3bf780f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '401f1914-438c-47b3-9c6d-d40287f5b254', 'volume_name': 'volume-401f1914-438c-47b3-9c6d-d40287f5b254', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca31a812-be74-448f-b77f-2d9897f9bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca31a812-be74-448f-b77f-2d9897f9bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c75698-24cb-4d3d-8d49-1a4e7f11fc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:52 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Volume 401f1914-438c-47b3-9c6d-d40287f5b254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-401f1914-438c-47b3-9c6d-d40287f5b254', 'volume_size': 1} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-31550702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=401f1914-438c-47b3-9c6d-d40287f5b254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576d8f77b49b447991b3f3d8a419e533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:53Z,use_quota=True,user_id='ad8a2a7b577b4944bf7f336ed5a6c49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1dc7c28e-b324-442c-88b2-9ca2786e1e39),volume_type_id=1dc7c28e-b324-442c-88b2-9ca2786e1e39)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Creating volume 401f1914-438c-47b3-9c6d-d40287f5b254 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:52 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:52 devstack sudo[104477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254 1073741824 Jul 24 12:52:52 devstack sudo[104477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Flow 'volume_create_manager' (d7c8a99b-19c7-4f67-bc93-f6f698b05305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843650fb-1af9-43c5-a3e8-a481fc3d3b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843650fb-1af9-43c5-a3e8-a481fc3d3b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-194102488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74e18e4-1435-4ff1-becf-c2d75435f139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576d8f77b49b447991b3f3d8a419e533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:53Z,use_quota=True,user_id='ad8a2a7b577b4944bf7f336ed5a6c49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75b64a2a-50b1-473f-aa06-b3fda51c3ae5),volume_type_id=75b64a2a-50b1-473f-aa06-b3fda51c3ae5)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:53 devstack sudo[104477]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdffe401-cd8b-4ed3-9946-e4d35a90b035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdffe401-cd8b-4ed3-9946-e4d35a90b035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b61357c-bab4-48c2-851c-4710244d65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b61357c-bab4-48c2-851c-4710244d65dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74e18e4-1435-4ff1-becf-c2d75435f139', 'volume_name': 'volume-e74e18e4-1435-4ff1-becf-c2d75435f139', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757d0c21-a70d-4f67-b389-f4cf9d7547f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757d0c21-a70d-4f67-b389-f4cf9d7547f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f5161f-32e6-43df-8085-d60767ecba69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:53 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Volume e74e18e4-1435-4ff1-becf-c2d75435f139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74e18e4-1435-4ff1-becf-c2d75435f139', 'volume_size': 1} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254 1073741824" returned: 0 in 0.704s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:53 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254 Jul 24 12:52:53 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:53 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254" returned: 0 in 0.327s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.396s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-194102488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74e18e4-1435-4ff1-becf-c2d75435f139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576d8f77b49b447991b3f3d8a419e533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:53Z,use_quota=True,user_id='ad8a2a7b577b4944bf7f336ed5a6c49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75b64a2a-50b1-473f-aa06-b3fda51c3ae5),volume_type_id=75b64a2a-50b1-473f-aa06-b3fda51c3ae5)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Creating volume e74e18e4-1435-4ff1-becf-c2d75435f139 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:53 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c75698-24cb-4d3d-8d49-1a4e7f11fc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-401f1914-438c-47b3-9c6d-d40287f5b254', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:53 devstack sudo[104522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139 1073741824 Jul 24 12:52:53 devstack sudo[104522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28f51a1-e3ad-45ee-a4ce-2a1fa95c3ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:53 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Volume volume-401f1914-438c-47b3-9c6d-d40287f5b254 (401f1914-438c-47b3-9c6d-d40287f5b254): created successfully Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28f51a1-e3ad-45ee-a4ce-2a1fa95c3ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Flow 'volume_create_manager' (a3d82a9c-a07e-493b-a1ce-f754babeedab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-bd9f2ff4-25f7-4d2b-b8cb-b89ee58af5fd tempest-TestInstancesWithCinderVolumes-1562982922 None] Created volume successfully. Jul 24 12:52:53 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Flow 'volume_create_manager' (62f400cd-0ad1-4278-babd-e3e451d922d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d397188-4cbb-40dd-ba28-670038d08a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d397188-4cbb-40dd-ba28-670038d08a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1994925845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f03b89-b07a-49c0-8eae-62cd23f837bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576d8f77b49b447991b3f3d8a419e533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:54Z,use_quota=True,user_id='ad8a2a7b577b4944bf7f336ed5a6c49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3986ee5f-cc6a-4d6e-9acc-4c10fea8ed01),volume_type_id=3986ee5f-cc6a-4d6e-9acc-4c10fea8ed01)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9ad570-0d67-42cb-8d7b-bd690e22fd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9ad570-0d67-42cb-8d7b-bd690e22fd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8024fb8-1ce4-4bf0-867b-3763b2608770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.image.glance [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Creating Keystone auth plugin from conf {{(pid=88540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8024fb8-1ce4-4bf0-867b-3763b2608770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1f03b89-b07a-49c0-8eae-62cd23f837bd', 'volume_name': 'volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd', 'volume_size': 1, 'image_id': '1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--148739016', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '576d8f77b49b447991b3f3d8a419e533', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'created_at': datetime.datetime(2026, 7, 24, 10, 52, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 52, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ebb3c8c-39ca-4c2c-8589-3d9ff854f826/file', 'properties': {}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27abfd1-f7cd-4d99-826e-b2dfc5e18b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27abfd1-f7cd-4d99-826e-b2dfc5e18b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde096e1-46dc-4817-a0e4-b725716fbb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:54 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Volume a1f03b89-b07a-49c0-8eae-62cd23f837bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd', 'volume_size': 1, 'image_id': '1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--148739016', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '576d8f77b49b447991b3f3d8a419e533', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'created_at': datetime.datetime(2026, 7, 24, 10, 52, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 52, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ebb3c8c-39ca-4c2c-8589-3d9ff854f826/file', 'properties': {}}, 'image_service': } Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Trying to clone a1f03b89-b07a-49c0-8eae-62cd23f837bd from image 1ebb3c8c-39ca-4c2c-8589-3d9ff854f826 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'metadata': {}}]). {{(pid=88540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 12:52:54 devstack sudo[104522]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139 1073741824" returned: 0 in 0.521s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:54 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139 Jul 24 12:52:54 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:54 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139" returned: 0 in 0.296s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f5161f-32e6-43df-8085-d60767ecba69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74e18e4-1435-4ff1-becf-c2d75435f139', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a37d2f5-3c83-4907-93a3-141af85710cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:52:54 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Volume volume-e74e18e4-1435-4ff1-becf-c2d75435f139 (e74e18e4-1435-4ff1-becf-c2d75435f139): created successfully Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a37d2f5-3c83-4907-93a3-141af85710cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:52:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Flow 'volume_create_manager' (d7c8a99b-19c7-4f67-bc93-f6f698b05305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:52:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cfa64004-31c0-4c8a-bd11-e7bff3f453ee tempest-TestInstancesWithCinderVolumes-1562982922 None] Created volume successfully. Jul 24 12:52:57 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD, size 20.69 MB, duration 3.46 sec {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 12:52:57 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Image download 20.69 MB at 5.98 MB/s Jul 24 12:52:57 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0273ef69-017a-4a30-baf5-a33b7c26482a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:57 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD Jul 24 12:52:57 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:58 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Temporary image 1ebb3c8c-39ca-4c2c-8589-3d9ff854f826 is fetched for user ad8a2a7b577b4944bf7f336ed5a6c49a. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f9099b-294d-4f07-97f1-3fd705344f93]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:58 devstack sudo[104537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD Jul 24 12:52:58 devstack sudo[104537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:58 devstack sudo[104537]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1994925845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f03b89-b07a-49c0-8eae-62cd23f837bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='576d8f77b49b447991b3f3d8a419e533',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:52:54Z,use_quota=True,user_id='ad8a2a7b577b4944bf7f336ed5a6c49a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3986ee5f-cc6a-4d6e-9acc-4c10fea8ed01),volume_type_id=3986ee5f-cc6a-4d6e-9acc-4c10fea8ed01)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Creating volume a1f03b89-b07a-49c0-8eae-62cd23f837bd {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:52:58 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:52:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:58 devstack sudo[104542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd 1073741824 Jul 24 12:52:58 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:59 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd 1073741824" returned: 0 in 0.456s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:59 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd Jul 24 12:52:59 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:59 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd" returned: 0 in 0.255s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Attempting download of 1ebb3c8c-39ca-4c2c-8589-3d9ff854f826 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'metadata': {}}])) to volume a1f03b89-b07a-49c0-8eae-62cd23f837bd. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb8fa6e-7f9a-4c7b-aaa8-d489e1809c06]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_9om_s5v8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:59 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_9om_s5v8 Jul 24 12:52:59 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:52:59 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_9om_s5v8" returned: 0 in 0.330s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:52:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_9om_s5v8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:52:59 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_9om_s5v8 Jul 24 12:52:59 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:00 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_9om_s5v8" returned: 1 in 0.370s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_9om_s5v8' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:53:00 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ab4599-4026-4f23-b57c-3fd9e52a269f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:00 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD Jul 24 12:53:00 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:00 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:00 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] 1ebb3c8c-39ca-4c2c-8589-3d9ff854f826 was qcow2, converting to qcow2 {{(pid=88540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 12:53:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:00 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd Jul 24 12:53:00 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:02 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd" returned: 0 in 1.893s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ebb3c8c-39ca-4c2c-8589-3d9ff854f826_c82k5sy3devstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:53:02 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Converted 112.00 MB image at 59.11 MB/s Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:02 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd 1G Jul 24 12:53:02 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:02 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd 1G" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Downloaded image 1ebb3c8c-39ca-4c2c-8589-3d9ff854f826 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'metadata': {}}])) to volume a1f03b89-b07a-49c0-8eae-62cd23f837bd successfully. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Temporary image 1ebb3c8c-39ca-4c2c-8589-3d9ff854f826 for user ad8a2a7b577b4944bf7f336ed5a6c49a is deleted. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Marking volume a1f03b89-b07a-49c0-8eae-62cd23f837bd as bootable. {{(pid=88540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Copying metadata from image 1ebb3c8c-39ca-4c2c-8589-3d9ff854f826 to a1f03b89-b07a-49c0-8eae-62cd23f837bd. {{(pid=88540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Creating volume glance metadata for volume a1f03b89-b07a-49c0-8eae-62cd23f837bd backed by image 1ebb3c8c-39ca-4c2c-8589-3d9ff854f826 with: {'image_id': '1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'image_name': 'tempest-scenario-img--148739016', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde096e1-46dc-4817-a0e4-b725716fbb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd', 'volume_size': 1, 'image_id': '1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--148739016', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '576d8f77b49b447991b3f3d8a419e533', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1ebb3c8c-39ca-4c2c-8589-3d9ff854f826', 'created_at': datetime.datetime(2026, 7, 24, 10, 52, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 52, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ebb3c8c-39ca-4c2c-8589-3d9ff854f826/file', 'properties': {}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d4377f-22bf-4c85-961a-501dd4789170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:02 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Volume volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd (a1f03b89-b07a-49c0-8eae-62cd23f837bd): created successfully Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d4377f-22bf-4c85-961a-501dd4789170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Flow 'volume_create_manager' (62f400cd-0ad1-4278-babd-e3e451d922d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:53:02 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2674e5f3-e716-45e6-9cd4-525601bfaaa6 tempest-TestInstancesWithCinderVolumes-1562982922 None] Created volume successfully. Jul 24 12:53:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-fd65d7f1-6819-4cdd-a9e6-52a67445cd7c req-efe91ed8-8e9f-4556-be14-11413bd06a0a tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-fd65d7f1-6819-4cdd-a9e6-52a67445cd7c req-efe91ed8-8e9f-4556-be14-11413bd06a0a tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-fd65d7f1-6819-4cdd-a9e6-52a67445cd7c req-efe91ed8-8e9f-4556-be14-11413bd06a0a tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-fd65d7f1-6819-4cdd-a9e6-52a67445cd7c req-efe91ed8-8e9f-4556-be14-11413bd06a0a tempest-TestInstancesWithCinderVolumes-1562982922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23da672f-0b4d-44e4-a969-e48541074a9c', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:53:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-fd65d7f1-6819-4cdd-a9e6-52a67445cd7c req-efe91ed8-8e9f-4556-be14-11413bd06a0a tempest-TestInstancesWithCinderVolumes-1562982922 None] attachment_update completed successfully. Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Flow 'volume_create_manager' (26f80556-2485-4606-908f-7157fb50238e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c854de3-a539-4cc9-b61f-6676427d30f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c854de3-a539-4cc9-b61f-6676427d30f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2129535231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7552f30-70b5-4d75-9c70-0c110606cd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31eb8a5229f4bf8ba887132a7d979b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:53:08Z,use_quota=True,user_id='49ab419a695248e3812bc9be080ea34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79abf783-6df6-4f25-8bba-01176f37b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79abf783-6df6-4f25-8bba-01176f37b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5ad55c-d958-4c75-949d-ae18c29ba3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd5ad55c-d958-4c75-949d-ae18c29ba3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7552f30-70b5-4d75-9c70-0c110606cd85', 'volume_name': 'volume-e7552f30-70b5-4d75-9c70-0c110606cd85', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdf52a2-1390-4db4-9b03-aef72102aa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fdf52a2-1390-4db4-9b03-aef72102aa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2735ed9f-ff90-43e0-9390-f5837dff0421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:07 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Volume e7552f30-70b5-4d75-9c70-0c110606cd85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7552f30-70b5-4d75-9c70-0c110606cd85', 'volume_size': 1} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2129535231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7552f30-70b5-4d75-9c70-0c110606cd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31eb8a5229f4bf8ba887132a7d979b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:53:08Z,use_quota=True,user_id='49ab419a695248e3812bc9be080ea34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Creating volume e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:53:07 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:53:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:07 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 1073741824 Jul 24 12:53:07 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:08 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 1073741824" returned: 0 in 0.419s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:08 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 Jul 24 12:53:08 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:08 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85" returned: 0 in 0.236s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2735ed9f-ff90-43e0-9390-f5837dff0421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7552f30-70b5-4d75-9c70-0c110606cd85', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2dd0d99-f4cb-43d8-acca-f713d8461154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:08 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Volume volume-e7552f30-70b5-4d75-9c70-0c110606cd85 (e7552f30-70b5-4d75-9c70-0c110606cd85): created successfully Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2dd0d99-f4cb-43d8-acca-f713d8461154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Flow 'volume_create_manager' (26f80556-2485-4606-908f-7157fb50238e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:53:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-449f0206-b4ee-4ab2-abfc-275d8004c4e8 tempest-SnapshotDependencyTests-329921387 None] Created volume successfully. Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Creating offline snapshot 39cbe4f3-175e-4b30-a639-5cc6e00084cb of volume e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ff9b29-a62c-4c26-bdf1-63246749ab78]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:08 devstack sudo[104608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 Jul 24 12:53:08 devstack sudo[104608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:09 devstack sudo[104608]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85" returned: 0 in 0.405s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:09 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb 1G Jul 24 12:53:09 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:09 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb 1G" returned: 0 in 0.396s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7552f30-70b5-4d75-9c70-0c110606cd85 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:09 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7552f30-70b5-4d75-9c70-0c110606cd85 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb Jul 24 12:53:09 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:09 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7552f30-70b5-4d75-9c70-0c110606cd85 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb" returned: 0 in 0.323s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:09 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb is being set with open permissions: ugo+rw Jul 24 12:53:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:10 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb Jul 24 12:53:10 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:10 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb" returned: 0 in 0.394s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:10 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.info Jul 24 12:53:10 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:10 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.info" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:10 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.info is being set with open permissions: ugo+rw Jul 24 12:53:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:10 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.info Jul 24 12:53:10 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:11 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.info" returned: 0 in 0.306s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.314s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:11 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9892127a-68e0-41e4-80ce-24ee8833df77 tempest-SnapshotDependencyTests-329921387 None] Create snapshot completed successfully Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Flow 'volume_create_manager' (aafe466c-b4ac-4539-a8b7-acc85578093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992a0f22-63fc-4e86-a9ac-c60e9dc9c808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992a0f22-63fc-4e86-a9ac-c60e9dc9c808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420bc3ca-3067-41aa-b066-5abccfb33cfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c31eb8a5229f4bf8ba887132a7d979b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39cbe4f3-175e-4b30-a639-5cc6e00084cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:53:13Z,use_quota=True,user_id='49ab419a695248e3812bc9be080ea34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbef5c50-b16c-48bd-b096-64e53a08ef3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbef5c50-b16c-48bd-b096-64e53a08ef3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bf9eec-df02-4f9e-84ca-10db88275c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bf9eec-df02-4f9e-84ca-10db88275c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '420bc3ca-3067-41aa-b066-5abccfb33cfb', 'volume_name': 'volume-420bc3ca-3067-41aa-b066-5abccfb33cfb', 'volume_size': 1, 'snapshot_id': '39cbe4f3-175e-4b30-a639-5cc6e00084cb'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8afd68b-6b8e-4fb2-bed4-f8c2be2992c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8afd68b-6b8e-4fb2-bed4-f8c2be2992c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a89d6f9-cb95-4818-9d37-d40cf127ebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:12 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Volume 420bc3ca-3067-41aa-b066-5abccfb33cfb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-420bc3ca-3067-41aa-b066-5abccfb33cfb', 'volume_size': 1, 'snapshot_id': '39cbe4f3-175e-4b30-a639-5cc6e00084cb'} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "cinder-quobyte-39cbe4f3-175e-4b30-a639-5cc6e00084cb-420bc3ca-3067-41aa-b066-5abccfb33cfb" by "_create_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-39cbe4f3-175e-4b30-a639-5cc6e00084cb-420bc3ca-3067-41aa-b066-5abccfb33cfb" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Creating volume 420bc3ca-3067-41aa-b066-5abccfb33cfb from snapshot 39cbe4f3-175e-4b30-a639-5cc6e00084cb {{(pid=88540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "cinder-quobyte-420bc3ca-3067-41aa-b066-5abccfb33cfb" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-420bc3ca-3067-41aa-b066-5abccfb33cfb" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] snapshot: 39cbe4f3-175e-4b30-a639-5cc6e00084cb, volume: 420bc3ca-3067-41aa-b066-5abccfb33cfb, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece6f789-0a88-4e9c-873d-282614ae0df7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:12 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb Jul 24 12:53:12 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:13 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb" returned: 0 in 0.446s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7552f30-70b5-4d75-9c70-0c110606cd85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:53:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:53:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:53:13 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e1bdb5-56a0-477a-aca3-02e996860dba]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:13 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 Jul 24 12:53:13 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:13 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85" returned: 0 in 0.407s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:13 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:53:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:13 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb Jul 24 12:53:13 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:19 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb" returned: 0 in 6.222s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:19 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[627dcd34-7e97-45f4-bce4-5c40256d7fe8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:20 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 Jul 24 12:53:20 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:20 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85" returned: 0 in 0.581s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85, size 1024.00 MB, duration 6.22 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:53:20 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Converted 1024.00 MB image at 164.53 MB/s Jul 24 12:53:20 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb is being set with open permissions: ugo+rw Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:20 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb Jul 24 12:53:20 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:20 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb" returned: 0 in 0.332s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-420bc3ca-3067-41aa-b066-5abccfb33cfb" released by "_copy_volume_from_snapshot" :: held 8.155s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-39cbe4f3-175e-4b30-a639-5cc6e00084cb-420bc3ca-3067-41aa-b066-5abccfb33cfb" released by "_create_volume_from_snapshot" :: held 8.203s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.219s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a89d6f9-cb95-4818-9d37-d40cf127ebac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420bc3ca-3067-41aa-b066-5abccfb33cfb', 'volume_size': 1, 'snapshot_id': '39cbe4f3-175e-4b30-a639-5cc6e00084cb'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3d3013-1d59-4377-8390-645aebc54497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:53:20 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Volume volume-420bc3ca-3067-41aa-b066-5abccfb33cfb (420bc3ca-3067-41aa-b066-5abccfb33cfb): created successfully Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3d3013-1d59-4377-8390-645aebc54497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:53:20 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Flow 'volume_create_manager' (aafe466c-b4ac-4539-a8b7-acc85578093a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:53:21 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d2b984cb-d93a-44ce-8af0-a8c9224d8762 tempest-SnapshotDependencyTests-329921387 None] Created volume successfully. Jul 24 12:53:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "cinder-39cbe4f3-175e-4b30-a639-5cc6e00084cb-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-39cbe4f3-175e-4b30-a639-5cc6e00084cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "cinder-quobyte-e7552f30-70b5-4d75-9c70-0c110606cd85" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-e7552f30-70b5-4d75-9c70-0c110606cd85" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "cinder-quobyte-39cbe4f3-175e-4b30-a639-5cc6e00084cb" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-39cbe4f3-175e-4b30-a639-5cc6e00084cb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:21 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Deleting offline snapshot 39cbe4f3-175e-4b30-a639-5cc6e00084cb of volume e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:53:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] snapshot_file for this snap is: volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:53:22 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee113b53-fad9-44fe-91fa-6d2e4634f19b]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:22 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb Jul 24 12:53:22 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:22 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb" returned: 0 in 0.408s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7552f30-70b5-4d75-9c70-0c110606cd85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:53:22 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b64f3df-6703-4c08-889c-dffda0a71958]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:22 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 Jul 24 12:53:22 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:22 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85" returned: 0 in 0.424s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:22 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb Jul 24 12:53:22 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:23 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb" returned: 0 in 0.406s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:23 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb Jul 24 12:53:23 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:23 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85.39cbe4f3-175e-4b30-a639-5cc6e00084cb" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-39cbe4f3-175e-4b30-a639-5cc6e00084cb" released by "_delete_snapshot" :: held 1.625s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-e7552f30-70b5-4d75-9c70-0c110606cd85" released by "delete_snapshot" :: held 1.653s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:23 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Created reservations ['caefb864-8be0-435c-b9e8-15d3162cf561', '5a89b410-bd09-4994-a602-acb6a1c333af', 'ad3d97ea-4900-4995-8e29-3dca883554ff', 'e8c246fb-1e8f-498c-ab92-4c8c450a0e67'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:53:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Delete snapshot completed successfully. Jul 24 12:53:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-343c15fc-fe2a-4d13-913f-d03049bd2e68 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-39cbe4f3-175e-4b30-a639-5cc6e00084cb-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "cinder-e7552f30-70b5-4d75-9c70-0c110606cd85-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-e7552f30-70b5-4d75-9c70-0c110606cd85-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "cinder-quobyte-e7552f30-70b5-4d75-9c70-0c110606cd85" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-e7552f30-70b5-4d75-9c70-0c110606cd85" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:24 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[210c88ad-068b-4b11-944b-92be2cbf27b7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:24 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 Jul 24 12:53:24 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:24 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85" returned: 0 in 0.429s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:24 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85 Jul 24 12:53:24 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:24 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e7552f30-70b5-4d75-9c70-0c110606cd85" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-e7552f30-70b5-4d75-9c70-0c110606cd85" released by "delete_volume" :: held 0.762s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Created reservations ['1b705046-0a40-41c9-a0a6-37d0942fe75a', 'f9bf2cdf-8ff2-433d-81a6-c7fd260068a8', '0f7ba725-106b-466e-b8b3-6a1d91583cb2', 'd5bacf58-e80f-464f-b0ef-82f2d972f4a0'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:25 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:53:25 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "cinder-420bc3ca-3067-41aa-b066-5abccfb33cfb-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-420bc3ca-3067-41aa-b066-5abccfb33cfb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:25 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:53:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Deleted volume successfully. Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "cinder-quobyte-420bc3ca-3067-41aa-b066-5abccfb33cfb" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-2e2b13a2-de38-4d11-b2e9-2a29720a0f6c tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-e7552f30-70b5-4d75-9c70-0c110606cd85-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-420bc3ca-3067-41aa-b066-5abccfb33cfb" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c42ff56-39d6-4d7a-aa38-24d0fdb65838]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:25 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb Jul 24 12:53:25 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:25 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb" returned: 0 in 0.364s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:25 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb Jul 24 12:53:25 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:26 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-420bc3ca-3067-41aa-b066-5abccfb33cfb" returned: 0 in 0.255s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-quobyte-420bc3ca-3067-41aa-b066-5abccfb33cfb" released by "delete_volume" :: held 0.660s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Created reservations ['c79a5965-412b-4ef3-bd5e-8dc45c97f9c0', '4615bb7b-5f93-4ce5-a375-5fa7ccc0d1b9', '3eb71f97-6cfb-4680-9c30-d2f926013dc7', 'fcf00838-3f5f-4094-b474-b3ed2cbc751b'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:26 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:53:26 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:26 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.267s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:53:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Deleted volume successfully. Jul 24 12:53:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b02f8caf-8411-4431-a86f-832cd4852f12 tempest-SnapshotDependencyTests-329921387 None] Lock "cinder-420bc3ca-3067-41aa-b066-5abccfb33cfb-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:36 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=44,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=3 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:53:36 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=42,cinder:SELECT=39,cinder:INSERT=16,cinder:DELETE=5 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:42 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:53:42 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:42 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.241s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:53:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:53:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-c63bf3e6-6aae-4160-92e4-e995330f09b2 req-dcd8cf6e-6ca7-4c0b-9b60-0a3a855ba17c tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-c63bf3e6-6aae-4160-92e4-e995330f09b2 req-dcd8cf6e-6ca7-4c0b-9b60-0a3a855ba17c tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-c63bf3e6-6aae-4160-92e4-e995330f09b2 req-dcd8cf6e-6ca7-4c0b-9b60-0a3a855ba17c tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:45 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-c63bf3e6-6aae-4160-92e4-e995330f09b2 req-dcd8cf6e-6ca7-4c0b-9b60-0a3a855ba17c tempest-TestInstancesWithCinderVolumes-1562982922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-401f1914-438c-47b3-9c6d-d40287f5b254', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e67feca-7666-4419-8e9e-b9b8964b1b0d', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:53:45 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-c63bf3e6-6aae-4160-92e4-e995330f09b2 req-dcd8cf6e-6ca7-4c0b-9b60-0a3a855ba17c tempest-TestInstancesWithCinderVolumes-1562982922 None] attachment_update completed successfully. Jul 24 12:53:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-d4dae9fb-cbd3-441c-a100-f59cb268ec14 req-56cdb6cb-c737-4f5c-af0d-4132339d5f91 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-d4dae9fb-cbd3-441c-a100-f59cb268ec14 req-56cdb6cb-c737-4f5c-af0d-4132339d5f91 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-d4dae9fb-cbd3-441c-a100-f59cb268ec14 req-56cdb6cb-c737-4f5c-af0d-4132339d5f91 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:47 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-d4dae9fb-cbd3-441c-a100-f59cb268ec14 req-56cdb6cb-c737-4f5c-af0d-4132339d5f91 tempest-TestInstancesWithCinderVolumes-1562982922 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-e74e18e4-1435-4ff1-becf-c2d75435f139', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba5d06d3-fe56-4f4e-9c74-08c063e327f9', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:53:47 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-d4dae9fb-cbd3-441c-a100-f59cb268ec14 req-56cdb6cb-c737-4f5c-af0d-4132339d5f91 tempest-TestInstancesWithCinderVolumes-1562982922 None] attachment_update completed successfully. Jul 24 12:53:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-9addfe8d-bfb2-44e3-a2cf-bbf0c318e22f req-0a68cd3a-3fe7-4f60-b004-2d682b84d41a tempest-TestInstancesWithCinderVolumes-1562982922 None] Terminate volume connection completed successfully. Jul 24 12:53:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-9addfe8d-bfb2-44e3-a2cf-bbf0c318e22f req-0a68cd3a-3fe7-4f60-b004-2d682b84d41a tempest-TestInstancesWithCinderVolumes-1562982922 None] Deleting attachment 0e67feca-7666-4419-8e9e-b9b8964b1b0d. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:53:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "cinder-401f1914-438c-47b3-9c6d-d40287f5b254-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-401f1914-438c-47b3-9c6d-d40287f5b254-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "cinder-quobyte-401f1914-438c-47b3-9c6d-d40287f5b254" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-quobyte-401f1914-438c-47b3-9c6d-d40287f5b254" acquired by "delete_volume" :: waited 0.013s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d26c093-dc72-4de1-a0aa-67cb3730afa0]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:52 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254 Jul 24 12:53:52 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:52 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254" returned: 0 in 0.371s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:52 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254 Jul 24 12:53:52 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:52 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-401f1914-438c-47b3-9c6d-d40287f5b254" returned: 0 in 0.260s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-quobyte-401f1914-438c-47b3-9c6d-d40287f5b254" released by "delete_volume" :: held 0.670s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:52 devstack cinder-volume[88540]: WARNING cinder.quota [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-609319969-97336491 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-609319969-97336491, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:53:52 devstack cinder-volume[88540]: WARNING cinder.quota [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-609319969-97336491 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-609319969-97336491, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Created reservations ['d244acb2-0969-4b7c-bf3b-fd82a453d035', '21142008-b3a1-4461-9c18-d8a5b70c8237', '0afe5b59-3edc-4dfb-a48e-643149ff6941', 'dfeb8603-7902-436c-969e-9c21d4e247d7'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:52 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:53:52 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:53 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:53 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:53:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deleted volume successfully. Jul 24 12:53:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b143f599-ac85-4cac-bde1-fecba1d4d580 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-401f1914-438c-47b3-9c6d-d40287f5b254-delete_volume" released by "delete_volume" :: held 1.132s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:55 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-df1003f0-cecd-4913-a8c1-f230a9f08ba5 req-74169c23-1ec2-4331-97cf-9e3c44b54377 tempest-TestInstancesWithCinderVolumes-1562982922 None] Terminate volume connection completed successfully. Jul 24 12:53:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-df1003f0-cecd-4913-a8c1-f230a9f08ba5 req-74169c23-1ec2-4331-97cf-9e3c44b54377 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deleting attachment ba5d06d3-fe56-4f4e-9c74-08c063e327f9. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:53:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "cinder-e74e18e4-1435-4ff1-becf-c2d75435f139-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-e74e18e4-1435-4ff1-becf-c2d75435f139-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "cinder-quobyte-e74e18e4-1435-4ff1-becf-c2d75435f139" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-quobyte-e74e18e4-1435-4ff1-becf-c2d75435f139" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc107aa9-428a-4c76-a7d6-eab134c25985]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:56 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139 Jul 24 12:53:56 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:56 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139" returned: 0 in 0.371s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:56 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139 Jul 24 12:53:56 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:56 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e74e18e4-1435-4ff1-becf-c2d75435f139" returned: 0 in 0.278s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-quobyte-e74e18e4-1435-4ff1-becf-c2d75435f139" released by "delete_volume" :: held 0.693s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:56 devstack cinder-volume[88540]: WARNING cinder.quota [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1076042039-1947463262 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1076042039-1947463262, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:53:56 devstack cinder-volume[88540]: WARNING cinder.quota [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1076042039-1947463262 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1076042039-1947463262, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Created reservations ['2ba1e831-440b-48b4-9fa6-3cdc59ca6459', '1e09aa82-5569-4cbb-ab0a-a68084a6ce27', 'e4a6e2cc-3b2d-4750-8fe0-1bdbe7ccad37', 'cec94ae8-7de8-4b40-ab80-ffae3ef0393a'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:53:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:53:56 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:53:56 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:53:57 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 24 12:53:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.292s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:53:57 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:53:57 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deleted volume successfully. Jul 24 12:53:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4f444e22-648f-4f6b-9c76-f92d656ae8f5 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-e74e18e4-1435-4ff1-becf-c2d75435f139-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:53:59 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-fee71844-a473-4d8d-97b8-1e9e07d81812 req-8778d4fc-68f5-4e00-9939-9982dc8ee256 tempest-TestInstancesWithCinderVolumes-1562982922 None] Terminate volume connection completed successfully. Jul 24 12:53:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-fee71844-a473-4d8d-97b8-1e9e07d81812 req-8778d4fc-68f5-4e00-9939-9982dc8ee256 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deleting attachment 23da672f-0b4d-44e4-a969-e48541074a9c. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:54:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "cinder-a1f03b89-b07a-49c0-8eae-62cd23f837bd-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:54:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-a1f03b89-b07a-49c0-8eae-62cd23f837bd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:54:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "cinder-quobyte-a1f03b89-b07a-49c0-8eae-62cd23f837bd" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:54:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-quobyte-a1f03b89-b07a-49c0-8eae-62cd23f837bd" acquired by "delete_volume" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:54:00 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d5bb07-f565-4b9c-af83-a8cb7bfb0df7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:54:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:54:00 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd Jul 24 12:54:00 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:54:01 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd" returned: 0 in 0.346s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:54:01 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd Jul 24 12:54:01 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:54:01 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1f03b89-b07a-49c0-8eae-62cd23f837bd" returned: 0 in 0.237s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-quobyte-a1f03b89-b07a-49c0-8eae-62cd23f837bd" released by "delete_volume" :: held 0.621s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:54:01 devstack cinder-volume[88540]: WARNING cinder.quota [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844944385-608149506 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844944385-608149506, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:54:01 devstack cinder-volume[88540]: WARNING cinder.quota [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844944385-608149506 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1844944385-608149506, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Created reservations ['916d6d1b-e13a-4d3f-98d1-d008fbc974ca', '5571ec2b-c47f-4e6e-afe2-aa15a806ad8c', '0cb6577f-61c5-4d9a-a898-8e4c384dab6f', 'e759e0f5-fa73-4804-9153-c38412287a12'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:54:01 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:54:01 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:54:01 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.235s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:54:01 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Deleted volume successfully. Jul 24 12:54:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1317f5f3-30be-4640-8119-2fdb6e6f2380 tempest-TestInstancesWithCinderVolumes-1562982922 None] Lock "cinder-a1f03b89-b07a-49c0-8eae-62cd23f837bd-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:54:11 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=32,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:54:11 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=31,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Flow 'volume_create_manager' (fae15d07-919d-49a9-a12c-c17052d535b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb226c2-572f-4e75-b3dc-05d4f9c7da0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb226c2-572f-4e75-b3dc-05d4f9c7da0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1372957937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c22dd6-3817-42d4-9e30-819eb8f87597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8bcbc8b01734b3598c14e9fe4aa157e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:54:39Z,use_quota=True,user_id='65b7208fa21f411899a3e88f43683de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6798c8e-d8b4-41ed-b909-164320a8c26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6798c8e-d8b4-41ed-b909-164320a8c26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a6ba90-52bb-4adc-87fe-1e2ea31cbe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a6ba90-52bb-4adc-87fe-1e2ea31cbe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04c22dd6-3817-42d4-9e30-819eb8f87597', 'volume_name': 'volume-04c22dd6-3817-42d4-9e30-819eb8f87597', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0657a3a-071c-40dd-b284-17e67e6b9419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0657a3a-071c-40dd-b284-17e67e6b9419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0513df-3fea-4621-a823-23cbef6e3ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:54:39 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Volume 04c22dd6-3817-42d4-9e30-819eb8f87597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04c22dd6-3817-42d4-9e30-819eb8f87597', 'volume_size': 1} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1372957937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04c22dd6-3817-42d4-9e30-819eb8f87597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8bcbc8b01734b3598c14e9fe4aa157e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:54:39Z,use_quota=True,user_id='65b7208fa21f411899a3e88f43683de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Creating volume 04c22dd6-3817-42d4-9e30-819eb8f87597 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:54:39 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:54:39 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597 1073741824 Jul 24 12:54:39 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:54:39 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597 1073741824" returned: 0 in 0.447s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:54:39 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597 Jul 24 12:54:39 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:54:39 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597" returned: 0 in 0.239s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0513df-3fea-4621-a823-23cbef6e3ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04c22dd6-3817-42d4-9e30-819eb8f87597', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5fa2f5-d95c-419f-8343-cb9305a88d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:54:39 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Volume volume-04c22dd6-3817-42d4-9e30-819eb8f87597 (04c22dd6-3817-42d4-9e30-819eb8f87597): created successfully Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e5fa2f5-d95c-419f-8343-cb9305a88d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:54:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Flow 'volume_create_manager' (fae15d07-919d-49a9-a12c-c17052d535b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:54:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b25032ea-4bfe-4c72-a5e0-82beca3cae19 tempest-TestMinimumBasicScenario-649373476 None] Created volume successfully. Jul 24 12:54:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-54a48b59-8b3b-483a-9215-07af8d9f04d2 req-b6ddf5f1-e7e6-417f-b189-4113e41a38c9 tempest-TestMinimumBasicScenario-649373476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:54:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-54a48b59-8b3b-483a-9215-07af8d9f04d2 req-b6ddf5f1-e7e6-417f-b189-4113e41a38c9 tempest-TestMinimumBasicScenario-649373476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:54:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-54a48b59-8b3b-483a-9215-07af8d9f04d2 req-b6ddf5f1-e7e6-417f-b189-4113e41a38c9 tempest-TestMinimumBasicScenario-649373476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:54:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-54a48b59-8b3b-483a-9215-07af8d9f04d2 req-b6ddf5f1-e7e6-417f-b189-4113e41a38c9 tempest-TestMinimumBasicScenario-649373476 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-04c22dd6-3817-42d4-9e30-819eb8f87597', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '962fdd11-cccd-42c8-be79-60bccc9edd74', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:54:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-54a48b59-8b3b-483a-9215-07af8d9f04d2 req-b6ddf5f1-e7e6-417f-b189-4113e41a38c9 tempest-TestMinimumBasicScenario-649373476 None] attachment_update completed successfully. Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:54:42 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:54:42 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:54:42 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.249s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:54:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:54:51 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=4,cinder:SELECT=7,cinder:DELETE=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:54:51 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:55:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-9db4fe26-3d2a-4f82-be8c-65284ff6f55d req-2648c009-760a-4469-bfc4-65ab72305b93 tempest-TestMinimumBasicScenario-649373476 None] Terminate volume connection completed successfully. Jul 24 12:55:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-9db4fe26-3d2a-4f82-be8c-65284ff6f55d req-2648c009-760a-4469-bfc4-65ab72305b93 tempest-TestMinimumBasicScenario-649373476 None] Deleting attachment 962fdd11-cccd-42c8-be79-60bccc9edd74. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:55:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Acquiring lock "cinder-04c22dd6-3817-42d4-9e30-819eb8f87597-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:55:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Lock "cinder-04c22dd6-3817-42d4-9e30-819eb8f87597-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:55:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Acquiring lock "cinder-quobyte-04c22dd6-3817-42d4-9e30-819eb8f87597" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:55:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Lock "cinder-quobyte-04c22dd6-3817-42d4-9e30-819eb8f87597" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:55:27 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ca3394-a2e9-4d23-b0e3-1b6271112496]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:55:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:55:28 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597 Jul 24 12:55:28 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:55:28 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597" returned: 0 in 0.346s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:55:28 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597 Jul 24 12:55:28 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:55:28 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-04c22dd6-3817-42d4-9e30-819eb8f87597" returned: 0 in 0.233s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Lock "cinder-quobyte-04c22dd6-3817-42d4-9e30-819eb8f87597" released by "delete_volume" :: held 0.615s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Created reservations ['de3c037f-b7b0-4ce0-96e4-b04adc0684ac', '03ddbda1-d05c-4fa2-a772-f76d04c8ea65', '141a6c59-335e-406a-aa92-5f922699b88e', 'eab2ece1-7a4d-4bf7-9f78-073cbe202f43'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:55:28 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:55:28 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:55:28 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.242s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:55:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Deleted volume successfully. Jul 24 12:55:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5f895296-b915-44d0-868c-b4faf4617e6d tempest-TestMinimumBasicScenario-649373476 None] Lock "cinder-04c22dd6-3817-42d4-9e30-819eb8f87597-delete_volume" released by "delete_volume" :: held 1.036s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:55:38 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:55:38 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:55:42 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:55:42 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:55:42 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.262s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:55:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:56:00 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:56:00 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Flow 'volume_create_manager' (f9eb51c2-f1e8-4799-9dff-713cb5552a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4a8cd1-555c-4a77-b159-9e28ec9a4b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4a8cd1-555c-4a77-b159-9e28ec9a4b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1810275197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0927c468-91db-4b89-974d-a9db1044d942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1123ae8a72f94475b1225e3e71de40a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:56:02Z,use_quota=True,user_id='1e9729672b9347ae8b6347541fd85b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3bf1a1-9f5f-48cb-869e-31f751006d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3bf1a1-9f5f-48cb-869e-31f751006d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13ec0d8-a135-41d8-8084-d62c5bc914db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.image.glance [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Creating Keystone auth plugin from conf {{(pid=88540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13ec0d8-a135-41d8-8084-d62c5bc914db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0927c468-91db-4b89-974d-a9db1044d942', 'volume_name': 'volume-0927c468-91db-4b89-974d-a9db1044d942', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb758ec-9005-4559-97ed-1f62d3db749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb758ec-9005-4559-97ed-1f62d3db749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2d67e0-8c45-42f5-9409-9eff5f40a20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:56:01 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Volume 0927c468-91db-4b89-974d-a9db1044d942: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0927c468-91db-4b89-974d-a9db1044d942', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 12:56:01 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Trying to clone 0927c468-91db-4b89-974d-a9db1044d942 from image b9bc6022-042c-4b2c-a61d-587b72521a75 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]). {{(pid=88540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 12:56:02 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 12:56:02 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Image download 20.69 MB at 20.69 MB/s Jul 24 12:56:02 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d635f13-8fcf-48a9-8b21-7875ac638627]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:56:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:02 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD Jul 24 12:56:02 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:02 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:02 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Temporary image b9bc6022-042c-4b2c-a61d-587b72521a75 is fetched for user 1e9729672b9347ae8b6347541fd85b64. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 12:56:02 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da941ba-117e-45d3-8f9a-09e5052e0ece]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:56:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:02 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD Jul 24 12:56:02 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:03 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD" returned: 0 in 0.320s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1810275197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0927c468-91db-4b89-974d-a9db1044d942,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1123ae8a72f94475b1225e3e71de40a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:56:02Z,use_quota=True,user_id='1e9729672b9347ae8b6347541fd85b64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Creating volume 0927c468-91db-4b89-974d-a9db1044d942 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:56:03 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:03 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 1073741824 Jul 24 12:56:03 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:03 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 1073741824" returned: 0 in 0.394s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:03 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 Jul 24 12:56:03 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:03 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942" returned: 0 in 0.238s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Attempting download of b9bc6022-042c-4b2c-a61d-587b72521a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}])) to volume 0927c468-91db-4b89-974d-a9db1044d942. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[87739917-7d4b-453a-8733-3dc49896f82d]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:56:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_o2cjg2rt {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:03 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_o2cjg2rt Jul 24 12:56:03 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:04 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_o2cjg2rt" returned: 0 in 0.315s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_o2cjg2rt {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:04 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_o2cjg2rt Jul 24 12:56:04 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:04 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_o2cjg2rt" returned: 1 in 0.314s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9bc6022-042c-4b2c-a61d-587b72521a75_o2cjg2rt' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:56:04 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[019dff83-b859-43a8-b5de-497fef8bb855]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:56:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:04 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD Jul 24 12:56:04 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:04 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD" returned: 0 in 0.319s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:04 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] b9bc6022-042c-4b2c-a61d-587b72521a75 was qcow2, converting to qcow2 {{(pid=88540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 12:56:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:04 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 Jul 24 12:56:04 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:06 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942" returned: 0 in 1.505s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9bc6022-042c-4b2c-a61d-587b72521a75_2lg003m0devstack@QuobyteHD, size 112.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:56:06 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Converted 112.00 MB image at 74.34 MB/s Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:06 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 1G Jul 24 12:56:06 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:06 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 1G" returned: 0 in 0.297s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Downloaded image b9bc6022-042c-4b2c-a61d-587b72521a75 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}])) to volume 0927c468-91db-4b89-974d-a9db1044d942 successfully. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Temporary image b9bc6022-042c-4b2c-a61d-587b72521a75 for user 1e9729672b9347ae8b6347541fd85b64 is deleted. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Marking volume 0927c468-91db-4b89-974d-a9db1044d942 as bootable. {{(pid=88540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Copying metadata from image b9bc6022-042c-4b2c-a61d-587b72521a75 to 0927c468-91db-4b89-974d-a9db1044d942. {{(pid=88540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Creating volume glance metadata for volume 0927c468-91db-4b89-974d-a9db1044d942 backed by image b9bc6022-042c-4b2c-a61d-587b72521a75 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c2d67e0-8c45-42f5-9409-9eff5f40a20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0927c468-91db-4b89-974d-a9db1044d942', 'volume_size': 1, 'image_id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9bc6022-042c-4b2c-a61d-587b72521a75', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '215a04061a634d9da8dea37c71760431', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9bc6022-042c-4b2c-a61d-587b72521a75', 'created_at': datetime.datetime(2026, 7, 24, 10, 33, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 33, 4, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9bc6022-042c-4b2c-a61d-587b72521a75/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbabdfd-737d-444d-963a-312b6171cbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:56:06 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Volume volume-0927c468-91db-4b89-974d-a9db1044d942 (0927c468-91db-4b89-974d-a9db1044d942): created successfully Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbabdfd-737d-444d-963a-312b6171cbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:56:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Flow 'volume_create_manager' (f9eb51c2-f1e8-4799-9dff-713cb5552a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:56:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-012126e7-36b7-47bf-9372-c5161467ea4a tempest-TestShelveInstance-1345278606 None] Created volume successfully. Jul 24 12:56:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-de4f9e62-5f9b-4a2d-8194-52bed7c1578b req-12d588ca-085a-4481-814b-0703ee8e3cb3 tempest-TestShelveInstance-1345278606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:56:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-de4f9e62-5f9b-4a2d-8194-52bed7c1578b req-12d588ca-085a-4481-814b-0703ee8e3cb3 tempest-TestShelveInstance-1345278606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:56:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-de4f9e62-5f9b-4a2d-8194-52bed7c1578b req-12d588ca-085a-4481-814b-0703ee8e3cb3 tempest-TestShelveInstance-1345278606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:56:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-de4f9e62-5f9b-4a2d-8194-52bed7c1578b req-12d588ca-085a-4481-814b-0703ee8e3cb3 tempest-TestShelveInstance-1345278606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-0927c468-91db-4b89-974d-a9db1044d942', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28a646f2-688e-4229-b181-d27f0ff12dae', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:56:09 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-de4f9e62-5f9b-4a2d-8194-52bed7c1578b req-12d588ca-085a-4481-814b-0703ee8e3cb3 tempest-TestShelveInstance-1345278606 None] attachment_update completed successfully. Jul 24 12:56:19 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=7 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:56:19 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=5,cinder:SELECT=18,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:56:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-7ff16d8c-9e0c-43a3-9f1c-f1728acd8148 req-661c81ee-52e1-407b-ade0-c96cf9873c5f tempest-TestShelveInstance-1345278606 None] Terminate volume connection completed successfully. Jul 24 12:56:39 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-7ff16d8c-9e0c-43a3-9f1c-f1728acd8148 req-661c81ee-52e1-407b-ade0-c96cf9873c5f tempest-TestShelveInstance-1345278606 None] Deleting attachment 28a646f2-688e-4229-b181-d27f0ff12dae. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:56:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-2bbf0abf-37ff-4021-9dfc-3c5602b4efe4 req-e11ca438-0e54-4633-8b6b-a8c2bb76e798 tempest-TestShelveInstance-1345278606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:56:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-2bbf0abf-37ff-4021-9dfc-3c5602b4efe4 req-e11ca438-0e54-4633-8b6b-a8c2bb76e798 tempest-TestShelveInstance-1345278606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:56:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-2bbf0abf-37ff-4021-9dfc-3c5602b4efe4 req-e11ca438-0e54-4633-8b6b-a8c2bb76e798 tempest-TestShelveInstance-1345278606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:56:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-2bbf0abf-37ff-4021-9dfc-3c5602b4efe4 req-e11ca438-0e54-4633-8b6b-a8c2bb76e798 tempest-TestShelveInstance-1345278606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4', 'name': 'volume-0927c468-91db-4b89-974d-a9db1044d942', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '894d64e6-aee5-477e-8d9c-9a176e978fde', 'enforce_multipath': True} {{(pid=88540) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 12:56:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-2bbf0abf-37ff-4021-9dfc-3c5602b4efe4 req-e11ca438-0e54-4633-8b6b-a8c2bb76e798 tempest-TestShelveInstance-1345278606 None] attachment_update completed successfully. Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:56:42 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:56:42 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:56:42 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.248s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:56:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:56:51 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:56:51 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=6 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:57:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-b69da5f5-b6cb-4bd0-8ae8-7eb9c87c7c79 tempest-TestShelveInstance-1345278606 None] Terminate volume connection completed successfully. Jul 24 12:57:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-b69da5f5-b6cb-4bd0-8ae8-7eb9c87c7c79 tempest-TestShelveInstance-1345278606 None] Deleting attachment 894d64e6-aee5-477e-8d9c-9a176e978fde. {{(pid=88540) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Acquiring lock "cinder-0927c468-91db-4b89-974d-a9db1044d942-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Lock "cinder-0927c468-91db-4b89-974d-a9db1044d942-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Acquiring lock "cinder-quobyte-0927c468-91db-4b89-974d-a9db1044d942" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Lock "cinder-quobyte-0927c468-91db-4b89-974d-a9db1044d942" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a902aea-c425-4da2-aa6d-69edd35da23b]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:09 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 Jul 24 12:57:09 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:09 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942" returned: 0 in 0.381s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:09 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942 Jul 24 12:57:09 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:09 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0927c468-91db-4b89-974d-a9db1044d942" returned: 0 in 0.238s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Lock "cinder-quobyte-0927c468-91db-4b89-974d-a9db1044d942" released by "delete_volume" :: held 0.665s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG cinder.quota [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Created reservations ['37bb6350-b1ba-4d6e-b2a1-24c99560999d', '5bd17bf7-80b9-4446-af6b-8a57add53091', '548fd2e4-a8be-4255-a3cb-3d429f11d5be', '94d72e0e-c8d5-4a6e-a197-8f1930307773'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:09 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:57:09 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:10 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.255s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:10 devstack cinder-volume[88540]: DEBUG cinder.manager [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:57:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Deleted volume successfully. Jul 24 12:57:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [req-df34c31c-fc86-468d-b8d6-efd35a04a17a req-74a297a3-1a34-4d8d-bd2a-55159da9279a tempest-TestShelveInstance-1345278606 None] Lock "cinder-0927c468-91db-4b89-974d-a9db1044d942-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:57:19 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:57:20 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Flow 'volume_create_manager' (4974b52e-f385-4057-aa6b-fc140a33cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ab92ad-6a3b-4d00-a889-8f3888753a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ab92ad-6a3b-4d00-a889-8f3888753a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e735e08-2984-4d61-a72f-8669ab24adba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fa230677c4b92a463fc17cc464900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:23Z,use_quota=True,user_id='52a5bef2174846138f84a12df890c20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(716024bf-97b5-479d-9082-8772afd07818),volume_type_id=716024bf-97b5-479d-9082-8772afd07818)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e9ac03-58fd-48de-92e9-a02182e59b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e9ac03-58fd-48de-92e9-a02182e59b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02038399-2d1a-402e-bc81-96bf973bdd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.image.glance [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Creating Keystone auth plugin from conf {{(pid=88540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02038399-2d1a-402e-bc81-96bf973bdd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e735e08-2984-4d61-a72f-8669ab24adba', 'volume_name': 'volume-0e735e08-2984-4d61-a72f-8669ab24adba', 'volume_size': 1, 'image_id': '6566680c-ab77-454a-b37c-40ff1bac4f5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6566680c-ab77-454a-b37c-40ff1bac4f5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bcb680e7d64f314daa738996016d1664', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be0fa230677c4b92a463fc17cc464900', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e3d662b8adf6b49badb310ffb2fc1c476b3d7cca07a2f41bd7b60e332de9eba7be8aa7870d0cbd0fc92a2a5ab073f84f4346583509add9403c43ff104aa6c1a', 'id': '6566680c-ab77-454a-b37c-40ff1bac4f5e', 'created_at': datetime.datetime(2026, 7, 24, 10, 57, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 57, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6566680c-ab77-454a-b37c-40ff1bac4f5e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00736c3-1b25-456b-84c8-897652ca1d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00736c3-1b25-456b-84c8-897652ca1d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691e9674-497b-4082-b257-23a59982cfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Volume 0e735e08-2984-4d61-a72f-8669ab24adba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e735e08-2984-4d61-a72f-8669ab24adba', 'volume_size': 1, 'image_id': '6566680c-ab77-454a-b37c-40ff1bac4f5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6566680c-ab77-454a-b37c-40ff1bac4f5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bcb680e7d64f314daa738996016d1664', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be0fa230677c4b92a463fc17cc464900', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e3d662b8adf6b49badb310ffb2fc1c476b3d7cca07a2f41bd7b60e332de9eba7be8aa7870d0cbd0fc92a2a5ab073f84f4346583509add9403c43ff104aa6c1a', 'id': '6566680c-ab77-454a-b37c-40ff1bac4f5e', 'created_at': datetime.datetime(2026, 7, 24, 10, 57, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 57, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6566680c-ab77-454a-b37c-40ff1bac4f5e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Trying to clone 0e735e08-2984-4d61-a72f-8669ab24adba from image 6566680c-ab77-454a-b37c-40ff1bac4f5e at location (None, [{'url': 'file:///opt/stack/data/glance/images/6566680c-ab77-454a-b37c-40ff1bac4f5e', 'metadata': {}}]). {{(pid=88540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 12:57:23 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Image download 0.00 MB at 0.00 MB/s Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[20910645-bf66-4fb5-a962-c16c7a603da3]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:23 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD Jul 24 12:57:23 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:24 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:24 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD Jul 24 12:57:24 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:24 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:57:24 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Temporary image 6566680c-ab77-454a-b37c-40ff1bac4f5e is fetched for user 52a5bef2174846138f84a12df890c20e. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 12:57:24 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ee4771-7086-477c-933d-2d49c475ff00]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:24 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD Jul 24 12:57:24 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:24 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:24 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD Jul 24 12:57:24 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:25 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e735e08-2984-4d61-a72f-8669ab24adba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be0fa230677c4b92a463fc17cc464900',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:23Z,use_quota=True,user_id='52a5bef2174846138f84a12df890c20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(716024bf-97b5-479d-9082-8772afd07818),volume_type_id=716024bf-97b5-479d-9082-8772afd07818)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Creating volume 0e735e08-2984-4d61-a72f-8669ab24adba {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:25 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:25 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba 1073741824 Jul 24 12:57:25 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:25 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba 1073741824" returned: 0 in 0.413s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:25 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba Jul 24 12:57:25 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:25 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba" returned: 0 in 0.241s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Attempting download of 6566680c-ab77-454a-b37c-40ff1bac4f5e ((None, [{'url': 'file:///opt/stack/data/glance/images/6566680c-ab77-454a-b37c-40ff1bac4f5e', 'metadata': {}}])) to volume 0e735e08-2984-4d61-a72f-8669ab24adba. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e342d-d64f-4687-a2c9-3e035e066a24]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6566680c-ab77-454a-b37c-40ff1bac4f5e_3_9g_a82 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:25 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6566680c-ab77-454a-b37c-40ff1bac4f5e_3_9g_a82 Jul 24 12:57:25 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:26 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6566680c-ab77-454a-b37c-40ff1bac4f5e_3_9g_a82" returned: 0 in 0.311s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6566680c-ab77-454a-b37c-40ff1bac4f5e_3_9g_a82 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:26 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6566680c-ab77-454a-b37c-40ff1bac4f5e_3_9g_a82 Jul 24 12:57:26 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:26 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6566680c-ab77-454a-b37c-40ff1bac4f5e_3_9g_a82" returned: 1 in 0.313s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6566680c-ab77-454a-b37c-40ff1bac4f5e_3_9g_a82' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:57:26 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee80aaa4-5cfa-4e7c-bb78-6676fd664287]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:26 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD Jul 24 12:57:26 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:26 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:26 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD Jul 24 12:57:26 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:27 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] 6566680c-ab77-454a-b37c-40ff1bac4f5e was raw, converting to qcow2 {{(pid=88540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:27 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba Jul 24 12:57:27 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:27 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba" returned: 0 in 0.402s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6566680c-ab77-454a-b37c-40ff1bac4f5e_6998jnhqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:57:27 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:27 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba 1G Jul 24 12:57:27 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:27 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba 1G" returned: 0 in 0.298s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Downloaded image 6566680c-ab77-454a-b37c-40ff1bac4f5e ((None, [{'url': 'file:///opt/stack/data/glance/images/6566680c-ab77-454a-b37c-40ff1bac4f5e', 'metadata': {}}])) to volume 0e735e08-2984-4d61-a72f-8669ab24adba successfully. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Temporary image 6566680c-ab77-454a-b37c-40ff1bac4f5e for user 52a5bef2174846138f84a12df890c20e is deleted. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Marking volume 0e735e08-2984-4d61-a72f-8669ab24adba as bootable. {{(pid=88540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Copying metadata from image 6566680c-ab77-454a-b37c-40ff1bac4f5e to 0e735e08-2984-4d61-a72f-8669ab24adba. {{(pid=88540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Creating volume glance metadata for volume 0e735e08-2984-4d61-a72f-8669ab24adba backed by image 6566680c-ab77-454a-b37c-40ff1bac4f5e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6566680c-ab77-454a-b37c-40ff1bac4f5e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'bcb680e7d64f314daa738996016d1664', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691e9674-497b-4082-b257-23a59982cfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e735e08-2984-4d61-a72f-8669ab24adba', 'volume_size': 1, 'image_id': '6566680c-ab77-454a-b37c-40ff1bac4f5e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6566680c-ab77-454a-b37c-40ff1bac4f5e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bcb680e7d64f314daa738996016d1664', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be0fa230677c4b92a463fc17cc464900', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7e3d662b8adf6b49badb310ffb2fc1c476b3d7cca07a2f41bd7b60e332de9eba7be8aa7870d0cbd0fc92a2a5ab073f84f4346583509add9403c43ff104aa6c1a', 'id': '6566680c-ab77-454a-b37c-40ff1bac4f5e', 'created_at': datetime.datetime(2026, 7, 24, 10, 57, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 57, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6566680c-ab77-454a-b37c-40ff1bac4f5e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6debcda7-59cb-4fb0-895e-5440fe70ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:27 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Volume volume-0e735e08-2984-4d61-a72f-8669ab24adba (0e735e08-2984-4d61-a72f-8669ab24adba): created successfully Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6debcda7-59cb-4fb0-895e-5440fe70ce22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Flow 'volume_create_manager' (4974b52e-f385-4057-aa6b-fc140a33cc49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fbcbfdae-42d0-41ff-a7ce-a99da5479369 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Created volume successfully. Jul 24 12:57:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Acquiring lock "cinder-0e735e08-2984-4d61-a72f-8669ab24adba-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "cinder-0e735e08-2984-4d61-a72f-8669ab24adba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Acquiring lock "cinder-quobyte-0e735e08-2984-4d61-a72f-8669ab24adba" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "cinder-quobyte-0e735e08-2984-4d61-a72f-8669ab24adba" acquired by "delete_volume" :: waited 0.013s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9b28be-15bb-404d-8c29-229dba9b7718]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:28 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba Jul 24 12:57:28 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:29 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba" returned: 0 in 0.356s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:29 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba Jul 24 12:57:29 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:29 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e735e08-2984-4d61-a72f-8669ab24adba" returned: 0 in 0.236s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "cinder-quobyte-0e735e08-2984-4d61-a72f-8669ab24adba" released by "delete_volume" :: held 0.632s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:57:29 devstack cinder-volume[88540]: WARNING cinder.quota [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:57:29 devstack cinder-volume[88540]: WARNING cinder.quota [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Created reservations ['982d9f7c-8f34-4120-aad7-2f7aed55de62', '8b7a4cae-97a1-4393-a52b-04fce14b855c', '26f997f8-4108-4eb7-8bb3-0668d476b8e4', '4094c45e-51b5-41ed-899c-5486106384e8'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:29 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:57:29 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:29 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.239s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:57:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Deleted volume successfully. Jul 24 12:57:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5beac17c-5794-4164-84a7-135c1dd5b1d1 tempest-VolumeAndVolumeTypeFromImageTest-2056647293 None] Lock "cinder-0e735e08-2984-4d61-a72f-8669ab24adba-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:57:39 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=12,cinder:UPDATE=17,cinder:INSERT=10 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:57:39 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:42 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:57:42 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:42 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.240s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:57:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (fccbe42a-ebe5-4d5c-a144-6422b56c137e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ea4c79-95b8-4168-8c59-ebe7a8117d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ea4c79-95b8-4168-8c59-ebe7a8117d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-989068959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba960390-a6ab-4d1c-80c4-34ca6553374b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:50Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8240f35b-8faa-4fd2-b7cb-cad3f50fb25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8240f35b-8faa-4fd2-b7cb-cad3f50fb25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bffa05e-aa5b-4309-aa72-64b999c7b38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bffa05e-aa5b-4309-aa72-64b999c7b38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba960390-a6ab-4d1c-80c4-34ca6553374b', 'volume_name': 'volume-ba960390-a6ab-4d1c-80c4-34ca6553374b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7126448d-c6b8-475a-a64d-8e4a6f514649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7126448d-c6b8-475a-a64d-8e4a6f514649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1587301e-c323-4611-85a4-3cba4bea381f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Volume ba960390-a6ab-4d1c-80c4-34ca6553374b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba960390-a6ab-4d1c-80c4-34ca6553374b', 'volume_size': 1} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-989068959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba960390-a6ab-4d1c-80c4-34ca6553374b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:50Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Creating volume ba960390-a6ab-4d1c-80c4-34ca6553374b {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:50 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:50 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b 1073741824 Jul 24 12:57:50 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (15a732fb-361d-408f-8da7-da8dac317e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83767d16-ea57-4f94-abbf-8e60846e6ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83767d16-ea57-4f94-abbf-8e60846e6ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-752279010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:51Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2666f24e-68f4-4268-8df2-373d0e44cf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2666f24e-68f4-4268-8df2-373d0e44cf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff13e1a3-2ae1-40ab-ac9c-248aa383a13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff13e1a3-2ae1-40ab-ac9c-248aa383a13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e', 'volume_name': 'volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a5b413-ba23-4fa9-a7a0-31870d8a4c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57a5b413-ba23-4fa9-a7a0-31870d8a4c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa7d750-da84-4816-8c63-99bb9984e1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume 355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e', 'volume_size': 1} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (43053ca9-6531-4cc1-bf5a-15348bc95836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5be9461-7ece-40ed-bef0-be344c3743e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5be9461-7ece-40ed-bef0-be344c3743e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1865468981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:51Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb685b0f-ac39-41d6-b4e6-69ed02dc1dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:50 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb685b0f-ac39-41d6-b4e6-69ed02dc1dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1d978a-5933-4fa4-ae61-1278db8f2a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed1d978a-5933-4fa4-ae61-1278db8f2a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e', 'volume_name': 'volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254af9d6-0586-4ccf-a7c9-be662e4e8249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (254af9d6-0586-4ccf-a7c9-be662e4e8249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926b9f21-e292-45de-a7c2-73b42eb1dd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Volume 981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e', 'volume_size': 1} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Flow 'volume_create_manager' (7fc2f7cf-3b6e-467e-854b-cfc9de6b71da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea40eda-f547-4afa-8352-c1f9526fcd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea40eda-f547-4afa-8352-c1f9526fcd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3adb96-f677-4996-ba76-01506e2b9ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4197eaaaa0ee487f8959b0edb82d41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:51Z,use_quota=True,user_id='0ce40428b10d4aada4126c93300c8d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d0d21a-f16f-40b2-959d-8012ab8080a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d0d21a-f16f-40b2-959d-8012ab8080a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4980b6ad-e256-4719-89d8-763eb663f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4980b6ad-e256-4719-89d8-763eb663f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c3adb96-f677-4996-ba76-01506e2b9ea8', 'volume_name': 'volume-8c3adb96-f677-4996-ba76-01506e2b9ea8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdc1c5b-8a43-49d0-a5ce-9ed2df2af443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdc1c5b-8a43-49d0-a5ce-9ed2df2af443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32027119-dcfa-441e-b765-fa18dbd28902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Volume 8c3adb96-f677-4996-ba76-01506e2b9ea8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c3adb96-f677-4996-ba76-01506e2b9ea8', 'volume_size': 1} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b 1073741824" returned: 0 in 0.611s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:51 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b Jul 24 12:57:51 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (defea070-d1c4-4bb0-8663-976d262d611a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e860fb13-bbeb-49a8-ba5a-75505d58e644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e860fb13-bbeb-49a8-ba5a-75505d58e644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1721459069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d712cc1-3551-4442-b478-5584fc8e7b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:51Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4439b56a-85d1-4149-9c9e-8c10d170280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4439b56a-85d1-4149-9c9e-8c10d170280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752a5e88-e27c-4d56-9c44-227d7b734ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752a5e88-e27c-4d56-9c44-227d7b734ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d712cc1-3551-4442-b478-5584fc8e7b8e', 'volume_name': 'volume-7d712cc1-3551-4442-b478-5584fc8e7b8e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331f0e49-c3da-4d2e-aab1-09c8cc345d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331f0e49-c3da-4d2e-aab1-09c8cc345d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33718c55-c46a-4498-ae8d-d65559dc5eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Volume 7d712cc1-3551-4442-b478-5584fc8e7b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d712cc1-3551-4442-b478-5584fc8e7b8e', 'volume_size': 1} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:51 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b" returned: 0 in 0.354s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.780s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-752279010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:51Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Creating volume 355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:51 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1587301e-c323-4611-85a4-3cba4bea381f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba960390-a6ab-4d1c-80c4-34ca6553374b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436ed440-2f9f-40d0-a71b-1b71ae5b23c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:51 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e 1073741824 Jul 24 12:57:51 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:51 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Volume volume-ba960390-a6ab-4d1c-80c4-34ca6553374b (ba960390-a6ab-4d1c-80c4-34ca6553374b): created successfully Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436ed440-2f9f-40d0-a71b-1b71ae5b23c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (fccbe42a-ebe5-4d5c-a144-6422b56c137e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ca86d601-44dc-4b38-b3a1-6b761b5597de tempest-CreateVolumesFromImageTest-1230506595 None] Created volume successfully. Jul 24 12:57:51 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (b7083379-bafa-4c37-8265-c7870e8b69a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75a9f64-5aa0-4598-bc06-b60ecaef6f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75a9f64-5aa0-4598-bc06-b60ecaef6f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1553704380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ae72b6-dc99-4a4a-9d97-e67770f19e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:52Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564dff70-9238-48c6-b435-ae546ad1f082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564dff70-9238-48c6-b435-ae546ad1f082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daa7260-afe5-4a21-849c-fe09c3329e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9daa7260-afe5-4a21-849c-fe09c3329e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ae72b6-dc99-4a4a-9d97-e67770f19e80', 'volume_name': 'volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250e1dfc-28d1-4a42-8cdc-e3afa70d202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250e1dfc-28d1-4a42-8cdc-e3afa70d202c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e1b4b2-fe28-45a5-b9e3-78f1111dda0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Volume e0ae72b6-dc99-4a4a-9d97-e67770f19e80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80', 'volume_size': 1} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:52 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e 1073741824" returned: 0 in 0.659s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (b10715b3-061f-436b-b420-5dcbe49794e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41282e86-7df9-4587-b07f-a863a851df82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41282e86-7df9-4587-b07f-a863a851df82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-159970296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5427ebbb-5f41-4415-be39-9d8b900f0f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:52Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3093bd6c-78eb-425f-8242-225fe05c0fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3093bd6c-78eb-425f-8242-225fe05c0fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc322448-e2fb-43c0-bb6f-a1f77a9613aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc322448-e2fb-43c0-bb6f-a1f77a9613aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5427ebbb-5f41-4415-be39-9d8b900f0f91', 'volume_name': 'volume-5427ebbb-5f41-4415-be39-9d8b900f0f91', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21087fd-94a6-4576-b49b-200ab835294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21087fd-94a6-4576-b49b-200ab835294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb83d32-8390-4f7a-9de0-e6217650dc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Volume 5427ebbb-5f41-4415-be39-9d8b900f0f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5427ebbb-5f41-4415-be39-9d8b900f0f91', 'volume_size': 1} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:52 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e Jul 24 12:57:52 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:52 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" returned: 0 in 0.242s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.669s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1865468981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:51Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Creating volume 981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:52 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:52 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e 1073741824 Jul 24 12:57:52 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa7d750-da84-4816-8c63-99bb9984e1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf4c1a1-e75b-4b93-abf5-42e699e42e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:52 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e (355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e): created successfully Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faf4c1a1-e75b-4b93-abf5-42e699e42e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:52 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (15a732fb-361d-408f-8da7-da8dac317e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:52 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2780bfe6-db15-4911-818d-e0c19bb73eb5 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created volume successfully. Jul 24 12:57:53 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e 1073741824" returned: 0 in 0.469s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:53 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e Jul 24 12:57:53 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:53 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e" returned: 0 in 0.254s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.198s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c3adb96-f677-4996-ba76-01506e2b9ea8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4197eaaaa0ee487f8959b0edb82d41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:51Z,use_quota=True,user_id='0ce40428b10d4aada4126c93300c8d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Creating volume 8c3adb96-f677-4996-ba76-01506e2b9ea8 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:53 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (926b9f21-e292-45de-a7c2-73b42eb1dd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:53 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 1073741824 Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e788029-37de-4140-99de-3f9f2f5650ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:53 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:53 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Volume volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e (981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e): created successfully Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e788029-37de-4140-99de-3f9f2f5650ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (43053ca9-6531-4cc1-bf5a-15348bc95836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d2c9a64d-98ba-4c70-b330-ae954f3b9e5d tempest-CreateVolumesFromImageTest-1230506595 None] Created volume successfully. Jul 24 12:57:53 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 1073741824" returned: 0 in 0.493s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:54 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 Jul 24 12:57:54 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:54 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8" returned: 0 in 0.301s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.744s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1721459069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d712cc1-3551-4442-b478-5584fc8e7b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:51Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Creating volume 7d712cc1-3551-4442-b478-5584fc8e7b8e {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:54 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:54 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e 1073741824 Jul 24 12:57:54 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Flow 'volume_create_manager' (a3515be5-f19f-4b9c-8b86-5fa7beb8c0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90637ce9-c034-4fc4-98f4-80b78f8ff690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32027119-dcfa-441e-b765-fa18dbd28902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c3adb96-f677-4996-ba76-01506e2b9ea8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbc08e2-843a-4efe-a8eb-7a5258f9671d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90637ce9-c034-4fc4-98f4-80b78f8ff690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84035173d974edca9fa3a2742674eb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:54Z,use_quota=True,user_id='25a81548169d4f1d880f9fc245826b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e754b8bc-cef6-4399-9a01-96c12671dd60),volume_type_id=e754b8bc-cef6-4399-9a01-96c12671dd60)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02923609-89a0-4ede-b14a-4380b4f8d20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02923609-89a0-4ede-b14a-4380b4f8d20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89661a8-4f62-4893-9a99-8b99a8577b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.image.glance [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Creating Keystone auth plugin from conf {{(pid=88540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 12:57:54 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Volume volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 (8c3adb96-f677-4996-ba76-01506e2b9ea8): created successfully Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dbc08e2-843a-4efe-a8eb-7a5258f9671d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Flow 'volume_create_manager' (7fc2f7cf-3b6e-467e-854b-cfc9de6b71da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-eae16c48-9cc3-4dc1-9e7b-7454df0778ec tempest-CinderUnicodeTest-1962594444 None] Created volume successfully. Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89661a8-4f62-4893-9a99-8b99a8577b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70', 'volume_name': 'volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70', 'volume_size': 1, 'image_id': 'c86fa87f-cb26-4bb6-a826-868876783038', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c86fa87f-cb26-4bb6-a826-868876783038', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3d1c28ea27ae06af952814170651bb7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c84035173d974edca9fa3a2742674eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5230e1d5e1429dbf9a8f0589ad7f4ce76c358222a9359d4c1b02fbb7cc743611a473621826ec60da3f4a848dade52cb1a4712aaa265221d7a8e9ff18efbc728d', 'id': 'c86fa87f-cb26-4bb6-a826-868876783038', 'created_at': datetime.datetime(2026, 7, 24, 10, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 57, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c86fa87f-cb26-4bb6-a826-868876783038/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796311da-3b1f-4f31-9580-bfc86e849c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796311da-3b1f-4f31-9580-bfc86e849c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba240eb2-451f-41c6-abfc-cefc6cf4730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:54 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Volume 8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70', 'volume_size': 1, 'image_id': 'c86fa87f-cb26-4bb6-a826-868876783038', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c86fa87f-cb26-4bb6-a826-868876783038', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3d1c28ea27ae06af952814170651bb7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c84035173d974edca9fa3a2742674eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5230e1d5e1429dbf9a8f0589ad7f4ce76c358222a9359d4c1b02fbb7cc743611a473621826ec60da3f4a848dade52cb1a4712aaa265221d7a8e9ff18efbc728d', 'id': 'c86fa87f-cb26-4bb6-a826-868876783038', 'created_at': datetime.datetime(2026, 7, 24, 10, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 57, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c86fa87f-cb26-4bb6-a826-868876783038/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Trying to clone 8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 from image c86fa87f-cb26-4bb6-a826-868876783038 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c86fa87f-cb26-4bb6-a826-868876783038', 'metadata': {}}]). {{(pid=88540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 12:57:54 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Image download 0.00 MB at 0.00 MB/s Jul 24 12:57:54 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e 1073741824" returned: 0 in 0.464s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9c8409-74cc-4354-88fa-8c6b370ddd80]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:54 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e Jul 24 12:57:54 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:54 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD Jul 24 12:57:54 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:55 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e" returned: 0 in 0.238s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1553704380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ae72b6-dc99-4a4a-9d97-e67770f19e80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:52Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Creating volume e0ae72b6-dc99-4a4a-9d97-e67770f19e80 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:55 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33718c55-c46a-4498-ae8d-d65559dc5eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d712cc1-3551-4442-b478-5584fc8e7b8e', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:55 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 1073741824 Jul 24 12:57:55 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e9b85e-6ce5-48f7-a082-7292031a644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:55 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:55 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Volume volume-7d712cc1-3551-4442-b478-5584fc8e7b8e (7d712cc1-3551-4442-b478-5584fc8e7b8e): created successfully Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0e9b85e-6ce5-48f7-a082-7292031a644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (defea070-d1c4-4bb0-8663-976d262d611a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:55 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7e840915-05ef-422c-8b02-4f1ccd576448 tempest-CreateVolumesFromImageTest-1230506595 None] Created volume successfully. Jul 24 12:57:55 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD Jul 24 12:57:55 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:55 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD" returned: 1 in 0.518s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Temporary image c86fa87f-cb26-4bb6-a826-868876783038 is fetched for user 25a81548169d4f1d880f9fc245826b36. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 12:57:55 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 1073741824" returned: 0 in 0.600s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[196a0705-3bb9-4615-98dc-1a16f5315bf6]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:55 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 Jul 24 12:57:55 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:55 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD Jul 24 12:57:55 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Flow 'volume_create_manager' (39c897d4-0126-4b67-84a3-cf356e71a56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f288c595-70dd-45b6-8bcc-242197a31008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f288c595-70dd-45b6-8bcc-242197a31008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1956168155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b4793c-54e3-4363-b35a-0495a8d403a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4197eaaaa0ee487f8959b0edb82d41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:56Z,use_quota=True,user_id='0ce40428b10d4aada4126c93300c8d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fcd9b7-850c-48c7-8681-f992ed396791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6fcd9b7-850c-48c7-8681-f992ed396791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4d79dc-c85b-466c-a9b6-edd612e6e87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4d79dc-c85b-466c-a9b6-edd612e6e87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1b4793c-54e3-4363-b35a-0495a8d403a8', 'volume_name': 'volume-a1b4793c-54e3-4363-b35a-0495a8d403a8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecd8daf-a611-410a-b291-d266592f28c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:56 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecd8daf-a611-410a-b291-d266592f28c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e20f2b-dba1-4390-8813-246bd3033ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:56 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Volume a1b4793c-54e3-4363-b35a-0495a8d403a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1b4793c-54e3-4363-b35a-0495a8d403a8', 'volume_size': 1} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80" returned: 0 in 0.307s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.621s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-159970296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5427ebbb-5f41-4415-be39-9d8b900f0f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c52abc0066d45548f860aa21dfdcf23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:52Z,use_quota=True,user_id='123d17add25b49b8936794c2d26dce8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Creating volume 5427ebbb-5f41-4415-be39-9d8b900f0f91 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:56 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5e1b4b2-fe28-45a5-b9e3-78f1111dda0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:56 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 1073741824 Jul 24 12:57:56 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb22cf7d-7e7e-4138-ab99-cd479b24a5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:56 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Volume volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 (e0ae72b6-dc99-4a4a-9d97-e67770f19e80): created successfully Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb22cf7d-7e7e-4138-ab99-cd479b24a5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (b7083379-bafa-4c37-8265-c7870e8b69a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:56 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-40e81be9-763c-48ae-b955-a311ef77297b tempest-CreateVolumesFromImageTest-1230506595 None] Created volume successfully. Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:56 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD Jul 24 12:57:56 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:56 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 1073741824" returned: 0 in 0.441s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:56 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD" returned: 1 in 0.370s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:56 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 Jul 24 12:57:56 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:56 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91" returned: 0 in 0.239s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.689s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebb83d32-8390-4f7a-9de0-e6217650dc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5427ebbb-5f41-4415-be39-9d8b900f0f91', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c45cf1-dcab-413e-8767-68f19b4867e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Creating offline snapshot bcd8611f-f308-428c-a268-2d4d200f2f5a of volume 355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:57:56 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Volume volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 (5427ebbb-5f41-4415-be39-9d8b900f0f91): created successfully Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c45cf1-dcab-413e-8767-68f19b4867e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Flow 'volume_create_manager' (b10715b3-061f-436b-b420-5dcbe49794e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74b4fdd-732c-484b-81dc-e847c816fb39]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9dba3685-b2ff-425a-80bf-3a87a691f196 tempest-CreateVolumesFromImageTest-1230506595 None] Created volume successfully. Jul 24 12:57:56 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e Jul 24 12:57:56 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:57 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" returned: 0 in 0.379s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-5427ebbb-5f41-4415-be39-9d8b900f0f91-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:57 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a 1G Jul 24 12:57:57 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-5427ebbb-5f41-4415-be39-9d8b900f0f91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-quobyte-5427ebbb-5f41-4415-be39-9d8b900f0f91" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-5427ebbb-5f41-4415-be39-9d8b900f0f91" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[956cacb4-228d-4331-bac3-0db408f3db8e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:57 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 Jul 24 12:57:57 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:57 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a 1G" returned: 0 in 0.400s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:57 devstack sudo[108138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a Jul 24 12:57:57 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:57 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91" returned: 0 in 0.364s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:57 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91 Jul 24 12:57:57 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:57 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a" returned: 0 in 0.293s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:57 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a is being set with open permissions: ugo+rw Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:57 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a Jul 24 12:57:57 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:57 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5427ebbb-5f41-4415-be39-9d8b900f0f91" returned: 0 in 0.252s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-5427ebbb-5f41-4415-be39-9d8b900f0f91" released by "delete_volume" :: held 0.665s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Created reservations ['b85f2930-ed12-4182-8759-d61c7aa5a037', '20e394fa-d771-47e3-996d-b0f700dad47b', '50a4f5ac-d51a-429b-99f9-3e933f36dbb9', 'd8a19dfc-7876-4857-a277-44688d722793'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:58 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:57:58 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:58 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a" returned: 0 in 0.252s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:58 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.info Jul 24 12:57:58 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:58 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.281s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:57:58 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Deleted volume successfully. Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-e0ae72b6-dc99-4a4a-9d97-e67770f19e80-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-686a424f-10b9-441f-96d1-3a24210f5dd1 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-5427ebbb-5f41-4415-be39-9d8b900f0f91-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-e0ae72b6-dc99-4a4a-9d97-e67770f19e80-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:58 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-quobyte-e0ae72b6-dc99-4a4a-9d97-e67770f19e80" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.info" returned: 0 in 0.295s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:58 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.info is being set with open permissions: ugo+rw Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-e0ae72b6-dc99-4a4a-9d97-e67770f19e80" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:58 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.info Jul 24 12:57:58 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b73b1b3-18cd-4a83-b4f2-d62e8110ce19]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:58 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 Jul 24 12:57:58 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:58 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.info" returned: 0 in 0.253s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.723s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1956168155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1b4793c-54e3-4363-b35a-0495a8d403a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4197eaaaa0ee487f8959b0edb82d41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:56Z,use_quota=True,user_id='0ce40428b10d4aada4126c93300c8d5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Creating volume a1b4793c-54e3-4363-b35a-0495a8d403a8 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:58 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:58 devstack sudo[108163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 1073741824 Jul 24 12:57:58 devstack sudo[108163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:58 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-479b5e6d-7734-4001-877c-4012cb4f34c4 tempest-CreateVolumesFromSnapshotTest-255571613 None] Create snapshot completed successfully Jul 24 12:57:58 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80" returned: 0 in 0.384s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:58 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80 Jul 24 12:57:58 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:59 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e0ae72b6-dc99-4a4a-9d97-e67770f19e80" returned: 0 in 0.256s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-e0ae72b6-dc99-4a4a-9d97-e67770f19e80" released by "delete_volume" :: held 0.682s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:57:59 devstack sudo[108163]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 1073741824" returned: 0 in 0.465s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Created reservations ['c3e5291d-f9a5-4e05-ac08-0f17a796f184', 'e0dbd9c2-e58e-41ae-ab9b-c7eb41616166', 'c4e640b1-45e2-4934-a1ed-447228e107ec', '47743e8c-15eb-4473-9c68-e7517a3d8d71'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:59 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 Jul 24 12:57:59 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:59 devstack sudo[108178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:57:59 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:59 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8" returned: 0 in 0.273s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.054s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c84035173d974edca9fa3a2742674eb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:57:54Z,use_quota=True,user_id='25a81548169d4f1d880f9fc245826b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e754b8bc-cef6-4399-9a01-96c12671dd60),volume_type_id=e754b8bc-cef6-4399-9a01-96c12671dd60)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Creating volume 8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:57:59 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09e20f2b-dba1-4390-8813-246bd3033ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1b4793c-54e3-4363-b35a-0495a8d403a8', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:59 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 1073741824 Jul 24 12:57:59 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6b08a6-e789-4cbe-bdee-520e595de012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-7d712cc1-3551-4442-b478-5584fc8e7b8e-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:59 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.331s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:57:59 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Volume volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 (a1b4793c-54e3-4363-b35a-0495a8d403a8): created successfully Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6b08a6-e789-4cbe-bdee-520e595de012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Flow 'volume_create_manager' (39c897d4-0126-4b67-84a3-cf356e71a56f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:59 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Deleted volume successfully. Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-7d712cc1-3551-4442-b478-5584fc8e7b8e-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:59 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4dddf4a4-cdeb-46cd-807f-1a1cca5b24b8 tempest-CinderUnicodeTest-1962594444 None] Created volume successfully. Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-a90d5f86-b34d-40f8-8f97-a01910de93f6 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-e0ae72b6-dc99-4a4a-9d97-e67770f19e80-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-quobyte-7d712cc1-3551-4442-b478-5584fc8e7b8e" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-7d712cc1-3551-4442-b478-5584fc8e7b8e" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[16de9200-03f6-400a-a0f2-00ae5e121b0b]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (bf3797a6-ed79-4bfd-bdc9-d319f2a444cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b32ca6-8201-4e58-8604-0ac750e88249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b32ca6-8201-4e58-8604-0ac750e88249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-658600883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368b6d9b-e141-4306-8116-bce319a9c4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:00Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:57:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63541e1b-80da-4e9f-af32-47320f65e331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63541e1b-80da-4e9f-af32-47320f65e331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d736146-0c56-4e60-95c2-cbb723b0cfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d736146-0c56-4e60-95c2-cbb723b0cfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368b6d9b-e141-4306-8116-bce319a9c4c9', 'volume_name': 'volume-368b6d9b-e141-4306-8116-bce319a9c4c9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51933dce-9ee0-4acb-ac96-7d91ffb3729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51933dce-9ee0-4acb-ac96-7d91ffb3729e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:00 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e Jul 24 12:58:00 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8ccf73-1487-4345-872a-99ba7726a315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:00 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume 368b6d9b-e141-4306-8116-bce319a9c4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368b6d9b-e141-4306-8116-bce319a9c4c9', 'volume_size': 1} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:00 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 1073741824" returned: 0 in 0.611s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:00 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 Jul 24 12:58:00 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:00 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (0d7451e0-a5af-4bf4-966c-636631ac3b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c83b6fc-765b-43b5-94eb-5862d8c14ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e" returned: 0 in 0.594s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c83b6fc-765b-43b5-94eb-5862d8c14ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1558981706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:00Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:00 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2491a29a-f245-441c-b62c-5db733d0eca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:00 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2491a29a-f245-441c-b62c-5db733d0eca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6aa395-8804-4a72-874b-505f83613133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6aa395-8804-4a72-874b-505f83613133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf', 'volume_name': 'volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47982f8-0542-4f58-a8b3-ff92a9f3cfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47982f8-0542-4f58-a8b3-ff92a9f3cfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5176f0e6-b6d9-4809-8935-5330c9384d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:00 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume 5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf', 'volume_size': 1} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:00 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70" returned: 0 in 0.308s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.558s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-658600883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368b6d9b-e141-4306-8116-bce319a9c4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:00Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Creating volume 368b6d9b-e141-4306-8116-bce319a9c4c9 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:00 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Attempting download of c86fa87f-cb26-4bb6-a826-868876783038 ((None, [{'url': 'file:///opt/stack/data/glance/images/c86fa87f-cb26-4bb6-a826-868876783038', 'metadata': {}}])) to volume 8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 12:58:00 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9 1073741824 Jul 24 12:58:00 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bceb0c5-bf48-400a-a7b3-edd12e5cdbcd]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c86fa87f-cb26-4bb6-a826-868876783038___y4my2z {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:00 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d712cc1-3551-4442-b478-5584fc8e7b8e" returned: 0 in 0.385s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-7d712cc1-3551-4442-b478-5584fc8e7b8e" released by "delete_volume" :: held 1.046s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:00 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c86fa87f-cb26-4bb6-a826-868876783038___y4my2z Jul 24 12:58:00 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:00 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Created reservations ['925be6b4-5592-4a57-86a1-1e3a74402836', '56a9dd6e-37dd-488a-9e70-b9a521846915', '06233bb9-2260-40a8-b829-2ddaa262aae9', '0e5b8107-90e6-4764-9128-b6996786cee1'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (401f29ad-f6e5-478a-b39d-bfa3e45bfcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7da10d-d064-46cf-a5a0-2e95793cda2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7da10d-d064-46cf-a5a0-2e95793cda2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701266161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086db257-d3d7-4f83-b325-b6d4572a6af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:01Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4519884b-9a81-4ef9-8e67-fb24fb2882bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4519884b-9a81-4ef9-8e67-fb24fb2882bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04170ce-4feb-4278-ab71-e007b557913d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c04170ce-4feb-4278-ab71-e007b557913d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086db257-d3d7-4f83-b325-b6d4572a6af1', 'volume_name': 'volume-086db257-d3d7-4f83-b325-b6d4572a6af1', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f59f21-d052-42a7-ae37-aa71cb21cdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f59f21-d052-42a7-ae37-aa71cb21cdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c54df44-c208-4a90-94d9-f7380d56de4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume 086db257-d3d7-4f83-b325-b6d4572a6af1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086db257-d3d7-4f83-b325-b6d4572a6af1', 'volume_size': 1} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:01 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:01 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:01 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c86fa87f-cb26-4bb6-a826-868876783038___y4my2z" returned: 0 in 0.606s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c86fa87f-cb26-4bb6-a826-868876783038___y4my2z {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:01 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9 1073741824" returned: 0 in 0.857s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:01 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c86fa87f-cb26-4bb6-a826-868876783038___y4my2z Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:01 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (709530d3-4344-492a-8c54-af33deb2002a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5406ae92-5afd-4bce-86f4-c0572867e9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.365s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:01 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9 Jul 24 12:58:01 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Deleted volume successfully. Jul 24 12:58:01 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5406ae92-5afd-4bce-86f4-c0572867e9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1953982477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=899ae8b0-45f3-4947-a5c6-25238572261b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:01Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f26fd95-5e07-4662-8a14-5f6be6769d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f26fd95-5e07-4662-8a14-5f6be6769d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e8c050-005c-4a74-8b76-9d31cf2b806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e8c050-005c-4a74-8b76-9d31cf2b806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '899ae8b0-45f3-4947-a5c6-25238572261b', 'volume_name': 'volume-899ae8b0-45f3-4947-a5c6-25238572261b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd74fed-a509-4ff2-a78f-2754ac0b0736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd74fed-a509-4ff2-a78f-2754ac0b0736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d20dea3-705f-4411-82da-75fd6c6c682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume 899ae8b0-45f3-4947-a5c6-25238572261b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-899ae8b0-45f3-4947-a5c6-25238572261b', 'volume_size': 1} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-1b7f4f2b-5120-4ea3-90e7-a23b5c6af50f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-7d712cc1-3551-4442-b478-5584fc8e7b8e-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:01 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c86fa87f-cb26-4bb6-a826-868876783038___y4my2z" returned: 1 in 0.488s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c86fa87f-cb26-4bb6-a826-868876783038___y4my2z' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85e8166-0636-4543-87e9-03b995a2a3f8]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:01 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9" returned: 0 in 0.330s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.379s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1558981706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:00Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Creating volume 5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:01 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de8ccf73-1487-4345-872a-99ba7726a315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368b6d9b-e141-4306-8116-bce319a9c4c9', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:01 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e111a79-5692-4988-b1d4-3c2b183d2e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:01 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD Jul 24 12:58:01 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:01 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf 1073741824 Jul 24 12:58:01 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:02 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume volume-368b6d9b-e141-4306-8116-bce319a9c4c9 (368b6d9b-e141-4306-8116-bce319a9c4c9): created successfully Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e111a79-5692-4988-b1d4-3c2b183d2e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (bf3797a6-ed79-4bfd-bdc9-d319f2a444cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (c6ac4cb3-1a1f-4089-8192-474596c26249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0317c9d6-e437-4553-be1f-867eadbacabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:02 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1c8e8212-2ce3-41ca-a855-c01c5b8e7a39 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created volume successfully. Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0317c9d6-e437-4553-be1f-867eadbacabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-539119108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2baca28-0a22-42f5-aa97-c2ac97647875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:02Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34fa922-7d60-443e-9406-a5e68cb08372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e34fa922-7d60-443e-9406-a5e68cb08372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25b1cdf-1113-4848-8583-87ced54cae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25b1cdf-1113-4848-8583-87ced54cae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2baca28-0a22-42f5-aa97-c2ac97647875', 'volume_name': 'volume-f2baca28-0a22-42f5-aa97-c2ac97647875', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06e8d7e-dc71-466b-a84d-2f93ac3835f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06e8d7e-dc71-466b-a84d-2f93ac3835f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b01b4b5-22da-4981-8b70-3532f62fc03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:02 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume f2baca28-0a22-42f5-aa97-c2ac97647875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2baca28-0a22-42f5-aa97-c2ac97647875', 'volume_size': 1} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:02 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-quobyte-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba518d74-6e13-424e-a611-ec873d80c973]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:02 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD Jul 24 12:58:02 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:02 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e Jul 24 12:58:02 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:02 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf 1073741824" returned: 0 in 0.465s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:02 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf Jul 24 12:58:02 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:02 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD" returned: 1 in 0.341s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] c86fa87f-cb26-4bb6-a826-868876783038 was raw, converting to qcow2 {{(pid=88540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:02 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 Jul 24 12:58:02 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:02 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e" returned: 0 in 0.390s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:02 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e Jul 24 12:58:02 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:02 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf" returned: 0 in 0.270s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.146s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Creating offline snapshot 61ba0be6-4b37-45eb-8acd-8519a39eb4a4 of volume a1b4793c-54e3-4363-b35a-0495a8d403a8 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5176f0e6-b6d9-4809-8935-5330c9384d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a4872a-55c6-4601-b3f1-d864570df5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[785828f5-9ccf-483c-b1aa-c0a28cf3ffbf]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:02 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf (5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf): created successfully Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a4872a-55c6-4601-b3f1-d864570df5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (0d7451e0-a5af-4bf4-966c-636631ac3b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:02 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a7df7e10-012b-430f-a425-a0ef2b52b3c1 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created volume successfully. Jul 24 12:58:02 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 Jul 24 12:58:02 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:02 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e" returned: 0 in 0.269s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e" released by "delete_volume" :: held 0.715s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Created reservations ['f245c8a6-62ce-4095-87ae-771a589f9b15', 'b2d2fa2b-6c02-4e37-a5f5-93325bb86015', '12e23064-43d4-4bf3-a61a-4184e984f782', 'd7202554-cd8d-4d97-856d-0a22b480e7d8'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:03 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:03 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:03 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70" returned: 0 in 0.593s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c86fa87f-cb26-4bb6-a826-868876783038_iycoo_vydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:58:03 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:03 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 1G Jul 24 12:58:03 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-ba960390-a6ab-4d1c-80c4-34ca6553374b-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:03 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8" returned: 0 in 0.464s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:03 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 1G Jul 24 12:58:03 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-ba960390-a6ab-4d1c-80c4-34ca6553374b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "cinder-quobyte-ba960390-a6ab-4d1c-80c4-34ca6553374b" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-ba960390-a6ab-4d1c-80c4-34ca6553374b" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b141584-c101-4213-b155-a9dc84c16c1c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:03 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.319s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Deleted volume successfully. Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-21133a4e-6286-4629-a05e-a8bc965ad945 tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-981b10f2-fa9c-4eb1-bd7d-b53a3e75df8e-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:03 devstack sudo[108263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b Jul 24 12:58:03 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:03 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 1G" returned: 0 in 0.411s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Downloaded image c86fa87f-cb26-4bb6-a826-868876783038 ((None, [{'url': 'file:///opt/stack/data/glance/images/c86fa87f-cb26-4bb6-a826-868876783038', 'metadata': {}}])) to volume 8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 successfully. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Temporary image c86fa87f-cb26-4bb6-a826-868876783038 for user 25a81548169d4f1d880f9fc245826b36 is deleted. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Marking volume 8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 as bootable. {{(pid=88540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Copying metadata from image c86fa87f-cb26-4bb6-a826-868876783038 to 8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70. {{(pid=88540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Creating volume glance metadata for volume 8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 backed by image c86fa87f-cb26-4bb6-a826-868876783038 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'c86fa87f-cb26-4bb6-a826-868876783038', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd3d1c28ea27ae06af952814170651bb7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba240eb2-451f-41c6-abfc-cefc6cf4730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70', 'volume_size': 1, 'image_id': 'c86fa87f-cb26-4bb6-a826-868876783038', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c86fa87f-cb26-4bb6-a826-868876783038', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3d1c28ea27ae06af952814170651bb7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c84035173d974edca9fa3a2742674eb4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5230e1d5e1429dbf9a8f0589ad7f4ce76c358222a9359d4c1b02fbb7cc743611a473621826ec60da3f4a848dade52cb1a4712aaa265221d7a8e9ff18efbc728d', 'id': 'c86fa87f-cb26-4bb6-a826-868876783038', 'created_at': datetime.datetime(2026, 7, 24, 10, 57, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 57, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c86fa87f-cb26-4bb6-a826-868876783038/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c642c9-0c95-4c04-9eeb-86ea13aba0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:03 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 1G" returned: 0 in 0.465s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:03 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Volume volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 (8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70): created successfully Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c642c9-0c95-4c04-9eeb-86ea13aba0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:03 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Flow 'volume_create_manager' (a3515be5-f19f-4b9c-8b86-5fa7beb8c0f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:03 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-a0490024-076f-4747-9c0d-201e83e81208 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Created volume successfully. Jul 24 12:58:03 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b" returned: 0 in 0.430s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:03 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b Jul 24 12:58:03 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Acquiring lock "cinder-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:04 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4" returned: 0 in 0.338s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:04 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 is being set with open permissions: ugo+rw Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "cinder-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:04 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 Jul 24 12:58:04 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:04 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-ba960390-a6ab-4d1c-80c4-34ca6553374b" returned: 0 in 0.299s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-quobyte-ba960390-a6ab-4d1c-80c4-34ca6553374b" released by "delete_volume" :: held 0.777s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Acquiring lock "cinder-quobyte-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "cinder-quobyte-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[982d363c-dd94-42cc-994e-19e71dc675e3]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Created reservations ['40224eba-6c47-4d99-9e37-cc51ec2c8c83', '70ff3369-c939-452e-83a6-5e743b2b35db', 'a84ae157-2e9a-47ea-8ae9-c60c0979ede8', '2c1af692-95e6-41af-9625-77d46edae6ff'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:04 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 Jul 24 12:58:04 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:04 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:04 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:04 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4" returned: 0 in 0.303s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:04 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.info Jul 24 12:58:04 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:04 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.269s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:04 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Deleted volume successfully. Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-adf3b927-2bf1-411f-8ca9-faa8c06a962f tempest-CreateVolumesFromImageTest-1230506595 None] Lock "cinder-ba960390-a6ab-4d1c-80c4-34ca6553374b-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:04 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70" returned: 0 in 0.430s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:04 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70 Jul 24 12:58:04 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:04 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.info" returned: 0 in 0.291s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:04 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.info is being set with open permissions: ugo+rw Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:04 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.info Jul 24 12:58:04 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:04 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70" returned: 0 in 0.273s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "cinder-quobyte-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70" released by "delete_volume" :: held 0.746s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:04 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.info" returned: 0 in 0.270s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.790s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1701266161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=086db257-d3d7-4f83-b325-b6d4572a6af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:01Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Creating volume 086db257-d3d7-4f83-b325-b6d4572a6af1 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:04 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:04 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Created reservations ['f6d2fcaa-7f30-460c-99cc-89038e678586', '2db50461-495d-47c9-a137-9c4f0af2c8d1', '76b0a26a-95a9-4210-a54a-ec1e66eeaffc', '7e17c6e0-06e4-4313-91b1-f72bd825bc98'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:04 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1 1073741824 Jul 24 12:58:04 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:05 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b4d5e500-929c-4413-9cfc-8973e9a106bb tempest-CinderUnicodeTest-1962594444 None] Create snapshot completed successfully Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:05 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:05 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:05 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.349s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:05 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Deleted volume successfully. Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c38ed7ec-dc19-4190-9486-446b7c6bd9e3 tempest-VolumeAndVolumeTypeFromImageTest-2040510984 None] Lock "cinder-8460cc1c-2f0b-4d2e-aeef-8e1966aa6b70-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:05 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1 1073741824" returned: 0 in 0.596s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:05 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1 Jul 24 12:58:05 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "cinder-61ba0be6-4b37-45eb-8acd-8519a39eb4a4-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-61ba0be6-4b37-45eb-8acd-8519a39eb4a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "cinder-quobyte-a1b4793c-54e3-4363-b35a-0495a8d403a8" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:05 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-quobyte-a1b4793c-54e3-4363-b35a-0495a8d403a8" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "cinder-quobyte-61ba0be6-4b37-45eb-8acd-8519a39eb4a4" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1" returned: 0 in 0.315s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.246s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1953982477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=899ae8b0-45f3-4947-a5c6-25238572261b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:01Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Creating volume 899ae8b0-45f3-4947-a5c6-25238572261b {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:05 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-quobyte-61ba0be6-4b37-45eb-8acd-8519a39eb4a4" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Deleting offline snapshot 61ba0be6-4b37-45eb-8acd-8519a39eb4a4 of volume a1b4793c-54e3-4363-b35a-0495a8d403a8 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:58:05 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b 1073741824 Jul 24 12:58:05 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] snapshot_file for this snap is: volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c54df44-c208-4a90-94d9-f7380d56de4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086db257-d3d7-4f83-b325-b6d4572a6af1', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b76c856-9a9e-41a5-a1ee-b6ed14036519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc778d2d-77c5-439f-b7c2-d4a8ff4777cc]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:06 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume volume-086db257-d3d7-4f83-b325-b6d4572a6af1 (086db257-d3d7-4f83-b325-b6d4572a6af1): created successfully Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b76c856-9a9e-41a5-a1ee-b6ed14036519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (401f29ad-f6e5-478a-b39d-bfa3e45bfcbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e751136b-0620-4e56-a6f5-f74ce9158874 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created volume successfully. Jul 24 12:58:06 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 Jul 24 12:58:06 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:06 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4" returned: 0 in 0.436s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1b4793c-54e3-4363-b35a-0495a8d403a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b858e5c2-1ad4-45e9-9b76-ee43cc034092]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:06 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b 1073741824" returned: 0 in 0.612s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:06 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 Jul 24 12:58:06 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:06 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b Jul 24 12:58:06 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:06 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b" returned: 0 in 0.339s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.739s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-539119108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2baca28-0a22-42f5-aa97-c2ac97647875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dc380b0f8204e0a8615820a9f1ed0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:02Z,use_quota=True,user_id='975e2777d9474ed9aba5984e8beb5e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Creating volume f2baca28-0a22-42f5-aa97-c2ac97647875 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:06 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:06 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8" returned: 0 in 0.491s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:06 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875 1073741824 Jul 24 12:58:06 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d20dea3-705f-4411-82da-75fd6c6c682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-899ae8b0-45f3-4947-a5c6-25238572261b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964b2457-7821-45b2-854b-930ea74b7b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:07 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 Jul 24 12:58:07 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume volume-899ae8b0-45f3-4947-a5c6-25238572261b (899ae8b0-45f3-4947-a5c6-25238572261b): created successfully Jul 24 12:58:07 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964b2457-7821-45b2-854b-930ea74b7b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (709530d3-4344-492a-8c54-af33deb2002a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:07 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-49ba4e4c-108e-424d-9357-4c5328bfc899 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created volume successfully. Jul 24 12:58:07 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4" returned: 0 in 0.447s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:07 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4 Jul 24 12:58:07 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:07 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875 1073741824" returned: 0 in 0.557s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:07 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875 Jul 24 12:58:07 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:07 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8.61ba0be6-4b37-45eb-8acd-8519a39eb4a4" returned: 0 in 0.338s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-quobyte-61ba0be6-4b37-45eb-8acd-8519a39eb4a4" released by "_delete_snapshot" :: held 1.879s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-quobyte-a1b4793c-54e3-4363-b35a-0495a8d403a8" released by "delete_snapshot" :: held 1.940s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:07 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b01b4b5-22da-4981-8b70-3532f62fc03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2baca28-0a22-42f5-aa97-c2ac97647875', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20114438-12f7-4cce-baf7-9311ad8922db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:07 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Volume volume-f2baca28-0a22-42f5-aa97-c2ac97647875 (f2baca28-0a22-42f5-aa97-c2ac97647875): created successfully Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20114438-12f7-4cce-baf7-9311ad8922db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:07 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Flow 'volume_create_manager' (c6ac4cb3-1a1f-4089-8192-474596c26249) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:07 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-49cb9871-79b6-4c95-b843-7a10d19fbe77 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created volume successfully. Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Created reservations ['2c1919f1-62c6-40ab-8e7b-93c38836f6f6', 'f7434ffc-9ef8-4e2e-a74f-f6fb39cea3a5', '834a9e50-fa65-45f0-b35f-2de0621fce52', '1d368da7-ce76-462a-9f89-13df8a0cc108'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Delete snapshot completed successfully. Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4a725e8c-ebb6-457b-9a43-793d8f2ffba7 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-61ba0be6-4b37-45eb-8acd-8519a39eb4a4-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Flow 'volume_create_manager' (9ab94475-87a9-4933-a435-90b7068a0826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c326e499-23d0-4c60-a184-5bd2a70f0111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c326e499-23d0-4c60-a184-5bd2a70f0111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2001841915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df4f403-3686-46ff-bcce-4638e83a0cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e45a932a051471c96a76d871ce189a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:08Z,use_quota=True,user_id='c2bf03e303b348bea248067eaf977f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c968b697-7ecb-4e50-86b2-d21428ede090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c968b697-7ecb-4e50-86b2-d21428ede090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893ba6bd-e19a-4cdf-9e77-d02ab066c86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893ba6bd-e19a-4cdf-9e77-d02ab066c86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df4f403-3686-46ff-bcce-4638e83a0cae', 'volume_name': 'volume-6df4f403-3686-46ff-bcce-4638e83a0cae', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad8b63b-c8af-4d9c-9f21-30d9b7c2293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad8b63b-c8af-4d9c-9f21-30d9b7c2293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed84df20-58b6-4899-a6a9-df87af78ec05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:08 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Volume 6df4f403-3686-46ff-bcce-4638e83a0cae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df4f403-3686-46ff-bcce-4638e83a0cae', 'volume_size': 1} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2001841915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6df4f403-3686-46ff-bcce-4638e83a0cae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e45a932a051471c96a76d871ce189a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:08Z,use_quota=True,user_id='c2bf03e303b348bea248067eaf977f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Creating volume 6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:08 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:08 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae 1073741824 Jul 24 12:58:08 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-f2baca28-0a22-42f5-aa97-c2ac97647875-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:08 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae 1073741824" returned: 0 in 0.483s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-f2baca28-0a22-42f5-aa97-c2ac97647875-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-quobyte-f2baca28-0a22-42f5-aa97-c2ac97647875" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:08 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae Jul 24 12:58:08 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-f2baca28-0a22-42f5-aa97-c2ac97647875" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82a2141-a439-45b9-be78-d03814f619aa]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:09 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875 Jul 24 12:58:09 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "cinder-a1b4793c-54e3-4363-b35a-0495a8d403a8-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-a1b4793c-54e3-4363-b35a-0495a8d403a8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:09 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae" returned: 0 in 0.308s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed84df20-58b6-4899-a6a9-df87af78ec05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df4f403-3686-46ff-bcce-4638e83a0cae', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f5f3e0-045e-403a-9c61-ccf7bf7b0318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:09 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Volume volume-6df4f403-3686-46ff-bcce-4638e83a0cae (6df4f403-3686-46ff-bcce-4638e83a0cae): created successfully Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f5f3e0-045e-403a-9c61-ccf7bf7b0318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Flow 'volume_create_manager' (9ab94475-87a9-4933-a435-90b7068a0826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "cinder-quobyte-a1b4793c-54e3-4363-b35a-0495a8d403a8" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:09 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5969e103-8884-4b1e-b83c-8885bc7e5c8a tempest-VolumeDependencyTests-1792512718 None] Created volume successfully. Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-quobyte-a1b4793c-54e3-4363-b35a-0495a8d403a8" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99fc396-2878-41b4-9c9f-dcd7f1e460f9]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:09 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875" returned: 0 in 0.456s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:09 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875 Jul 24 12:58:09 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:09 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 Jul 24 12:58:09 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:09 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-f2baca28-0a22-42f5-aa97-c2ac97647875" returned: 0 in 0.264s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-f2baca28-0a22-42f5-aa97-c2ac97647875" released by "delete_volume" :: held 0.769s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:09 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8" returned: 0 in 0.383s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:09 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8 Jul 24 12:58:09 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created reservations ['3e9fbb89-35e8-4009-aa7e-5c47a793a105', '37c51c28-8f64-4b8f-bb80-081e45cf85ec', '5a8f89c7-9699-4389-b679-7859a406fa6e', '334a7bad-2000-4723-ab2d-04a3b4c05eff'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:09 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:09 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:09 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a1b4793c-54e3-4363-b35a-0495a8d403a8" returned: 0 in 0.262s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-quobyte-a1b4793c-54e3-4363-b35a-0495a8d403a8" released by "delete_volume" :: held 0.717s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-899ae8b0-45f3-4947-a5c6-25238572261b-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-899ae8b0-45f3-4947-a5c6-25238572261b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-quobyte-899ae8b0-45f3-4947-a5c6-25238572261b" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Created reservations ['65bedac5-62d9-42e1-b9df-4a2e7e5b6361', '3c7c3958-bb55-4276-9b6e-1399de07b612', 'f8f1f285-cc48-40fe-a6e7-a5296a759544', 'a120d3bc-3daf-4d70-b89c-e03306986536'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-899ae8b0-45f3-4947-a5c6-25238572261b" acquired by "delete_volume" :: waited 0.035s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0af2a17-1c76-4631-95fa-61a2d662d7f1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:10 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.327s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Deleted volume successfully. Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ae5f6ce7-4094-4a12-bbc7-0c3e1b9fea96 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-f2baca28-0a22-42f5-aa97-c2ac97647875-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:10 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:10 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b Jul 24 12:58:10 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:10 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:10 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.351s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:10 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "cinder-8c3adb96-f677-4996-ba76-01506e2b9ea8-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Deleted volume successfully. Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b" returned: 0 in 0.494s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c0f8e6ec-da9f-4488-a987-0674ecf10955 tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-a1b4793c-54e3-4363-b35a-0495a8d403a8-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:10 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b Jul 24 12:58:10 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-8c3adb96-f677-4996-ba76-01506e2b9ea8-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Creating offline snapshot aaca8185-15b0-419b-9ea3-01f95fba1bd0 of volume 6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "cinder-quobyte-8c3adb96-f677-4996-ba76-01506e2b9ea8" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcb78f5-8773-4597-8686-8445ca1ae004]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-quobyte-8c3adb96-f677-4996-ba76-01506e2b9ea8" acquired by "delete_volume" :: waited 0.038s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20a24b5-b8a1-4ec5-b98f-44ab83c922c6]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (091d9156-7897-4ab9-a205-241d631498bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:10 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae Jul 24 12:58:10 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9964338-e85a-47ff-92c3-bd99357be738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:10 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9964338-e85a-47ff-92c3-bd99357be738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450763487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:11Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9869f9c8-4add-4e6a-8311-8012dbc1dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9869f9c8-4add-4e6a-8311-8012dbc1dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c364b8-cf24-4e94-a913-b9e2055b7a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37c364b8-cf24-4e94-a913-b9e2055b7a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2', 'volume_name': 'volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348ee560-5793-4739-94d5-7b771184aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (348ee560-5793-4739-94d5-7b771184aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1dec4e-743a-4603-bb22-d6958d62c912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:10 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume 1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2', 'volume_size': 1} Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:10 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-899ae8b0-45f3-4947-a5c6-25238572261b" returned: 0 in 0.331s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:10 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-899ae8b0-45f3-4947-a5c6-25238572261b" released by "delete_volume" :: held 0.872s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created reservations ['d0cf00f5-3756-4953-a00b-1b233d3d3d08', '2d1bde07-7254-4e66-b7ce-1f3f47cf6386', '87a01227-a0f8-4238-9b7a-59181ac3fdb3', 'e701d8f7-1db5-48e1-bbcb-05ec18f8c17f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:11 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:11 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:11 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-086db257-d3d7-4f83-b325-b6d4572a6af1-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae" returned: 0 in 0.446s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-086db257-d3d7-4f83-b325-b6d4572a6af1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:11 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8" returned: 0 in 0.422s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:11 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 1G Jul 24 12:58:11 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:11 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8 Jul 24 12:58:11 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-quobyte-086db257-d3d7-4f83-b325-b6d4572a6af1" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-086db257-d3d7-4f83-b325-b6d4572a6af1" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8184baa1-4326-4731-9006-0bb48edf36ea]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:11 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.309s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:11 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Deleted volume successfully. Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cabd57bd-d6bf-4d7c-aad3-564dfbb7af42 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-899ae8b0-45f3-4947-a5c6-25238572261b-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:11 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1 Jul 24 12:58:11 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:11 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-8c3adb96-f677-4996-ba76-01506e2b9ea8" returned: 0 in 0.308s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-quobyte-8c3adb96-f677-4996-ba76-01506e2b9ea8" released by "delete_volume" :: held 0.798s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Created reservations ['5f59a9e0-78b7-4c7c-a7fe-d3618a19911f', 'e4bc9bae-f698-49d1-b6e2-6e36f984b9c9', '9110e64f-1482-43e7-b151-aa63c277c020', 'a0601ad6-7f6d-4d9f-aa11-aac5240734f7'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:11 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 1G" returned: 0 in 0.526s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df4f403-3686-46ff-bcce-4638e83a0cae -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:11 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:11 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:11 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1" returned: 0 in 0.424s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:11 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df4f403-3686-46ff-bcce-4638e83a0cae -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 Jul 24 12:58:11 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:11 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1 Jul 24 12:58:11 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:11 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.284s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:11 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:11 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Deleted volume successfully. Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-01949fdd-f1a8-4062-a870-cb6b8b4a9adc tempest-CinderUnicodeTest-1962594444 None] Lock "cinder-8c3adb96-f677-4996-ba76-01506e2b9ea8-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:12 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-086db257-d3d7-4f83-b325-b6d4572a6af1" returned: 0 in 0.291s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-086db257-d3d7-4f83-b325-b6d4572a6af1" released by "delete_volume" :: held 0.765s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:12 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6df4f403-3686-46ff-bcce-4638e83a0cae -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0" returned: 0 in 0.368s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:12 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 is being set with open permissions: ugo+rw Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:12 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 Jul 24 12:58:12 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Created reservations ['c839b261-0276-46f8-9357-f84d6c189341', '20240e87-7842-4510-a8b0-d2572a0a3474', '925b4369-b8b1-4630-9e5b-d19b7c6d7605', '65d4113b-186a-4cf8-88bc-6c9636976b2d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:12 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:12 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:12 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0" returned: 0 in 0.288s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:12 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.295s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:12 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.info Jul 24 12:58:12 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Deleted volume successfully. Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-quobyte-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-99db0b73-1f82-4b71-a1f6-ca150659114b tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-086db257-d3d7-4f83-b325-b6d4572a6af1-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf" acquired by "delete_volume" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5949b96-999b-40a3-9d14-602734c607cc]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:12 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf Jul 24 12:58:12 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:12 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.info" returned: 0 in 0.353s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:12 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.info is being set with open permissions: ugo+rw Jul 24 12:58:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:12 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.info Jul 24 12:58:12 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:13 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf" returned: 0 in 0.412s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:13 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf Jul 24 12:58:13 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:13 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.info" returned: 0 in 0.296s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.433s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.186s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450763487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:11Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Creating volume 1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:13 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:13 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 1073741824 Jul 24 12:58:13 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-320cc0f1-cab6-4237-84b8-68d04d7c4915 tempest-VolumeDependencyTests-1792512718 None] Create snapshot completed successfully Jul 24 12:58:13 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf" returned: 0 in 0.285s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf" released by "delete_volume" :: held 0.773s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Created reservations ['0c73fcdd-fc6c-4be4-9132-ae9f1211b391', 'f01d5cf7-572d-41ad-bde2-bc3ce9eba5f0', '15a19ed8-5e43-4503-9eec-d7b3269b291d', '1725a61f-b3af-4dc1-9bba-6b192fd8850f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:13 devstack sudo[108463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:13 devstack sudo[108463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-368b6d9b-e141-4306-8116-bce319a9c4c9-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-368b6d9b-e141-4306-8116-bce319a9c4c9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:13 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 1073741824" returned: 0 in 0.600s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-quobyte-368b6d9b-e141-4306-8116-bce319a9c4c9" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:13 devstack sudo[108463]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.324s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Deleted volume successfully. Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-368b6d9b-e141-4306-8116-bce319a9c4c9" acquired by "delete_volume" :: waited 0.052s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[770d3629-e6b7-4ec2-b9ee-dec330edbb03]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-dd255d77-cdb5-45d8-a027-66c3231a213d tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-5b9150ab-92f6-4dfd-8dbd-a50b560f1ddf-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:13 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 Jul 24 12:58:13 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:13 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9 Jul 24 12:58:13 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:14 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e1dec4e-743a-4603-bb22-d6958d62c912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492eb053-6055-4aef-8ece-38446cea7338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:14 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 (1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2): created successfully Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492eb053-6055-4aef-8ece-38446cea7338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (091d9156-7897-4ab9-a205-241d631498bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f282ccbb-8b62-40a8-a784-737b9a246fa4 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created volume successfully. Jul 24 12:58:14 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9" returned: 0 in 0.468s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:14 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9 Jul 24 12:58:14 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Flow 'volume_create_manager' (18ee539b-2519-46f1-ba61-54af69d77c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02d4cc0-8ca3-4f91-a52d-ff2c3d1aba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b02d4cc0-8ca3-4f91-a52d-ff2c3d1aba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1652227397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e45a932a051471c96a76d871ce189a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aaca8185-15b0-419b-9ea3-01f95fba1bd0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:14Z,use_quota=True,user_id='c2bf03e303b348bea248067eaf977f9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d21adf6-760b-4984-9533-fb9989d9e18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d21adf6-760b-4984-9533-fb9989d9e18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd65cf6-8ac2-490b-a734-5dcb0c697a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efd65cf6-8ac2-490b-a734-5dcb0c697a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b', 'volume_name': 'volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b', 'volume_size': 1, 'snapshot_id': 'aaca8185-15b0-419b-9ea3-01f95fba1bd0'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a5f489-ad39-4a76-8aee-36cfc73557b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a5f489-ad39-4a76-8aee-36cfc73557b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93539c8d-94ae-4812-8a16-2d98931b6288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:14 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Volume 4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b', 'volume_size': 1, 'snapshot_id': 'aaca8185-15b0-419b-9ea3-01f95fba1bd0'} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "cinder-quobyte-aaca8185-15b0-419b-9ea3-01f95fba1bd0-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" by "_create_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-aaca8185-15b0-419b-9ea3-01f95fba1bd0-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Creating volume 4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b from snapshot aaca8185-15b0-419b-9ea3-01f95fba1bd0 {{(pid=88540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "cinder-quobyte-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:14 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-368b6d9b-e141-4306-8116-bce319a9c4c9" returned: 0 in 0.280s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] snapshot: aaca8185-15b0-419b-9ea3-01f95fba1bd0, volume: 4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-368b6d9b-e141-4306-8116-bce319a9c4c9" released by "delete_volume" :: held 0.810s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[92fd3efe-104a-492a-9957-dd3452da68d5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created reservations ['6ec0fe06-fe01-41d0-b566-df72a3223b45', 'df08e455-8e1e-4d77-82e4-e95dd3882202', '1f9bc981-b6f5-4871-8da4-457e72e491f8', 'de9062cd-b501-4352-b9b0-1a9346ca933c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:14 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 Jul 24 12:58:14 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:14 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:14 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:15 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:15 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Deleted volume successfully. Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0" returned: 0 in 0.442s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6df4f403-3686-46ff-bcce-4638e83a0cae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c11f143-1f45-4904-99a3-128a4afb3483]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-66a4428b-27eb-4207-b675-ac3fb720ead2 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-368b6d9b-e141-4306-8116-bce319a9c4c9-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:15 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae Jul 24 12:58:15 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (eda56c64-2e0d-4574-a36d-6a11e2d6a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189d87b7-eea9-498e-9731-28b2dea81770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:15 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae" returned: 0 in 0.503s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (189d87b7-eea9-498e-9731-28b2dea81770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421364447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb60802-196a-4363-9869-82be0de53d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:16Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5468e958-4a04-4c23-b4cb-4287a65d39ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:15 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5468e958-4a04-4c23-b4cb-4287a65d39ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:15 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb50172-71a2-407f-8b3e-36fcbece5fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb50172-71a2-407f-8b3e-36fcbece5fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb60802-196a-4363-9869-82be0de53d95', 'volume_name': 'volume-bcb60802-196a-4363-9869-82be0de53d95', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc448d99-946c-4a7b-a9ba-49b1af45ca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc448d99-946c-4a7b-a9ba-49b1af45ca3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313dd630-910b-46dc-951c-ff4abb17733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:15 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume bcb60802-196a-4363-9869-82be0de53d95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb60802-196a-4363-9869-82be0de53d95', 'volume_size': 1} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (76471fcf-c640-4d0c-ab4d-6ff364675b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc653ea-b4fe-4a41-b173-06f26206b52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc653ea-b4fe-4a41-b173-06f26206b52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1614089723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13e805f-6be7-4ef5-ac57-837c5298805c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:16Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab18a976-62cc-4ca5-a774-c882657f237b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab18a976-62cc-4ca5-a774-c882657f237b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177af568-b409-4750-a3f3-55bac4199ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177af568-b409-4750-a3f3-55bac4199ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a13e805f-6be7-4ef5-ac57-837c5298805c', 'volume_name': 'volume-a13e805f-6be7-4ef5-ac57-837c5298805c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a07736-e42a-4528-a0f6-bf589f365f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a07736-e42a-4528-a0f6-bf589f365f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb7a98a-b03f-4d2b-a604-19e1bfbf1999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:16 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume a13e805f-6be7-4ef5-ac57-837c5298805c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a13e805f-6be7-4ef5-ac57-837c5298805c', 'volume_size': 1} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-bcd8611f-f308-428c-a268-2d4d200f2f5a-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-bcd8611f-f308-428c-a268-2d4d200f2f5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-quobyte-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-quobyte-bcd8611f-f308-428c-a268-2d4d200f2f5a" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-bcd8611f-f308-428c-a268-2d4d200f2f5a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Deleting offline snapshot bcd8611f-f308-428c-a268-2d4d200f2f5a of volume 355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] snapshot_file for this snap is: volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[93968b4a-d5ce-4b96-848e-8a456c137c74]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:16 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a Jul 24 12:58:16 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (76ecb356-255b-490f-8c2a-4ab51347959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d12625-3708-4359-a87a-0848c67948e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d12625-3708-4359-a87a-0848c67948e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000711219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881786d8-85ab-4b04-a68c-4028654f5f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:17Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cd9de7-da91-4cf2-9465-776217ba6507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cd9de7-da91-4cf2-9465-776217ba6507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aff7cc9-e9f2-4f53-ab79-72b1b156d098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aff7cc9-e9f2-4f53-ab79-72b1b156d098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '881786d8-85ab-4b04-a68c-4028654f5f32', 'volume_name': 'volume-881786d8-85ab-4b04-a68c-4028654f5f32', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6a730d-6158-4d82-b8e0-70649bec01fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6a730d-6158-4d82-b8e0-70649bec01fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ede3b85-c277-472a-9821-f2ab82b68d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume 881786d8-85ab-4b04-a68c-4028654f5f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-881786d8-85ab-4b04-a68c-4028654f5f32', 'volume_size': 1} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:17 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a" returned: 0 in 1.073s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2380f2-81ae-4c22-b28b-459e076d9166]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (700c3367-c742-4d21-8429-5e6baa538e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9577b3b8-527f-44d9-895d-31d1fe684a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9577b3b8-527f-44d9-895d-31d1fe684a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555570309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5c87fd-97e5-45c8-abf6-44125f4c6912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:17Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5fcc56-d8ac-4e20-8e67-03b16adfbadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5fcc56-d8ac-4e20-8e67-03b16adfbadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e5be0a-0865-4259-8884-c0896d7f588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e5be0a-0865-4259-8884-c0896d7f588b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f5c87fd-97e5-45c8-abf6-44125f4c6912', 'volume_name': 'volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f9466a-a621-459f-9798-3e55e65ee9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f9466a-a621-459f-9798-3e55e65ee9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9581c193-9629-424e-a901-65a3b6d97c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:17 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume 1f5c87fd-97e5-45c8-abf6-44125f4c6912: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912', 'volume_size': 1} Jul 24 12:58:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:17 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e Jul 24 12:58:17 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:18 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" returned: 0 in 1.014s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:18 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a Jul 24 12:58:18 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (f0e2cc60-5494-47c0-8840-0ae23c4f35a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b08b60-da37-4331-840c-f6e859d8d0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90b08b60-da37-4331-840c-f6e859d8d0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-772749456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41fbf96-330a-4110-9d6c-f114211baa38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:19Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe84aaa5-7169-4867-a121-60895c7eb4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe84aaa5-7169-4867-a121-60895c7eb4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6628a6b9-c245-45ad-92fa-3947cd912915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6628a6b9-c245-45ad-92fa-3947cd912915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41fbf96-330a-4110-9d6c-f114211baa38', 'volume_name': 'volume-e41fbf96-330a-4110-9d6c-f114211baa38', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf7717f-e033-4315-84b4-d3fdc9e7181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf7717f-e033-4315-84b4-d3fdc9e7181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf698f01-0401-40c4-b063-4b1a1341179e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume e41fbf96-330a-4110-9d6c-f114211baa38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41fbf96-330a-4110-9d6c-f114211baa38', 'volume_size': 1} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:19 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a" returned: 0 in 0.850s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:19 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a Jul 24 12:58:19 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:19 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e.bcd8611f-f308-428c-a268-2d4d200f2f5a" returned: 0 in 0.596s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-bcd8611f-f308-428c-a268-2d4d200f2f5a" released by "_delete_snapshot" :: held 3.832s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" released by "delete_snapshot" :: held 3.894s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:20 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Created reservations ['b14ab82d-cd2c-4474-b8e4-2ab5fae411bf', '6c3abd04-a5df-4435-ad97-ce5928aec2e3', '95a65b8b-50ae-4755-a9be-8799862c67ae', '21a6d592-6372-4cad-be48-369d88592f14'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:20 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Delete snapshot completed successfully. Jul 24 12:58:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-baf3d224-3f0b-42f3-9cf4-fb39829610ed tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-bcd8611f-f308-428c-a268-2d4d200f2f5a-delete_snapshot" released by "delete_snapshot" :: held 4.221s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "cinder-quobyte-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" acquired by "delete_volume" :: waited 0.054s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:21 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b25627-d9fc-4560-a386-eec8dbde7303]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:21 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e Jul 24 12:58:21 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:21 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" returned: 0 in 5.995s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:21 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc3ded0-9901-4d47-8470-0245d805f686]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:21 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" returned: 0 in 0.568s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:21 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e Jul 24 12:58:21 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:21 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae Jul 24 12:58:21 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:21 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" returned: 0 in 0.257s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-quobyte-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e" released by "delete_volume" :: held 0.979s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Created reservations ['78fa89ce-dd67-489b-80fd-1aea260d7452', 'a6cdf546-4c4d-481b-b4e0-7b954ef59ea7', '6c6bc022-a2a8-44d2-a1ed-3982de270530', '12860f03-3b97-40d1-b213-2a471aba8dee'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:22 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae" returned: 0 in 0.601s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:58:22 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Converted 1024.00 MB image at 170.76 MB/s Jul 24 12:58:22 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b is being set with open permissions: ugo+rw Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:22 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:22 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:22 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b Jul 24 12:58:22 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:22 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:22 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Deleted volume successfully. Jul 24 12:58:22 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" returned: 0 in 0.267s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6ac9053a-a81e-4ea0-a88e-bd4fb87cac12 tempest-CreateVolumesFromSnapshotTest-255571613 None] Lock "cinder-355141ce-d0f8-490f-ab2a-ee0b3bbd2d6e-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" released by "_copy_volume_from_snapshot" :: held 7.927s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-aaca8185-15b0-419b-9ea3-01f95fba1bd0-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" released by "_create_volume_from_snapshot" :: held 7.974s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.990s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.836s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-421364447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb60802-196a-4363-9869-82be0de53d95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:16Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Creating volume bcb60802-196a-4363-9869-82be0de53d95 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:22 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:22 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95 1073741824 Jul 24 12:58:22 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93539c8d-94ae-4812-8a16-2d98931b6288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b', 'volume_size': 1, 'snapshot_id': 'aaca8185-15b0-419b-9ea3-01f95fba1bd0'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae9d5f2-6b28-463c-a15f-ad95c96feb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:22 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Volume volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b (4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b): created successfully Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae9d5f2-6b28-463c-a15f-ad95c96feb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:22 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Flow 'volume_create_manager' (18ee539b-2519-46f1-ba61-54af69d77c2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:22 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-09345d96-a5fc-4117-8eeb-545d7359488f tempest-VolumeDependencyTests-1792512718 None] Created volume successfully. Jul 24 12:58:23 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95 1073741824" returned: 0 in 0.453s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:23 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95 Jul 24 12:58:23 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:23 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.297s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1614089723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a13e805f-6be7-4ef5-ac57-837c5298805c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:16Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Creating volume a13e805f-6be7-4ef5-ac57-837c5298805c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:23 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313dd630-910b-46dc-951c-ff4abb17733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb60802-196a-4363-9869-82be0de53d95', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519e57af-96fe-4339-b7df-0490d198ab9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:23 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c 1073741824 Jul 24 12:58:23 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume volume-bcb60802-196a-4363-9869-82be0de53d95 (bcb60802-196a-4363-9869-82be0de53d95): created successfully Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (519e57af-96fe-4339-b7df-0490d198ab9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (eda56c64-2e0d-4574-a36d-6a11e2d6a75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:23 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1219323d-cf98-4fc5-8863-6fbc05362942 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created volume successfully. Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "cinder-aaca8185-15b0-419b-9ea3-01f95fba1bd0-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-aaca8185-15b0-419b-9ea3-01f95fba1bd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "cinder-quobyte-6df4f403-3686-46ff-bcce-4638e83a0cae" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-6df4f403-3686-46ff-bcce-4638e83a0cae" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "cinder-quobyte-aaca8185-15b0-419b-9ea3-01f95fba1bd0" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-aaca8185-15b0-419b-9ea3-01f95fba1bd0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Deleting offline snapshot aaca8185-15b0-419b-9ea3-01f95fba1bd0 of volume 6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] snapshot_file for this snap is: volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcc648a-a6eb-4375-a79d-3a373a1398a2]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:23 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 Jul 24 12:58:23 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Flow 'volume_create_manager' (0d7bcf3a-2b87-4e64-a3ae-9eb19b628a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad0ff2b-1ca0-461f-aef2-8909e782aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:23 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad0ff2b-1ca0-461f-aef2-8909e782aafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979411319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6411524-2691-4d2f-afa7-c21b771fe940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486ef5e878c74cf4b24d1c4a7463916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:24Z,use_quota=True,user_id='69277db851bd4c108117f66a138fc0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11f0088-4216-48c9-8faf-45cf22dd6ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11f0088-4216-48c9-8faf-45cf22dd6ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4792e736-48ae-40a6-bb75-6f0b58e464a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4792e736-48ae-40a6-bb75-6f0b58e464a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6411524-2691-4d2f-afa7-c21b771fe940', 'volume_name': 'volume-a6411524-2691-4d2f-afa7-c21b771fe940', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edd9037-f292-47d7-82d5-802dbba2c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3edd9037-f292-47d7-82d5-802dbba2c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc82d1b8-90f3-42cb-b3b0-d83d6f6a21b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:23 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Volume a6411524-2691-4d2f-afa7-c21b771fe940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6411524-2691-4d2f-afa7-c21b771fe940', 'volume_size': 1} Jul 24 12:58:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c 1073741824" returned: 0 in 0.670s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:24 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c Jul 24 12:58:24 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:24 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0" returned: 0 in 0.475s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6df4f403-3686-46ff-bcce-4638e83a0cae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[45142947-4823-4e88-8d9a-a9d4eee04e67]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:24 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae Jul 24 12:58:24 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:24 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c" returned: 0 in 0.326s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.211s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1000711219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=881786d8-85ab-4b04-a68c-4028654f5f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:17Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Creating volume 881786d8-85ab-4b04-a68c-4028654f5f32 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:24 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb7a98a-b03f-4d2b-a604-19e1bfbf1999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a13e805f-6be7-4ef5-ac57-837c5298805c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1bdfc47-0cf1-49eb-a4ed-19664751f313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:24 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32 1073741824 Jul 24 12:58:24 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:24 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume volume-a13e805f-6be7-4ef5-ac57-837c5298805c (a13e805f-6be7-4ef5-ac57-837c5298805c): created successfully Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1bdfc47-0cf1-49eb-a4ed-19664751f313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (76471fcf-c640-4d0c-ab4d-6ff364675b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9d227728-c714-4558-8255-04d9f0f70de9 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created volume successfully. Jul 24 12:58:24 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae" returned: 0 in 0.402s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:24 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 Jul 24 12:58:24 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:24 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32 1073741824" returned: 0 in 0.538s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:24 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0" returned: 0 in 0.401s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:24 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32 Jul 24 12:58:24 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:25 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0 Jul 24 12:58:25 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:25 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32" returned: 0 in 0.246s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.402s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-555570309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f5c87fd-97e5-45c8-abf6-44125f4c6912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:17Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Creating volume 1f5c87fd-97e5-45c8-abf6-44125f4c6912 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:25 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:25 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ede3b85-c277-472a-9821-f2ab82b68d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-881786d8-85ab-4b04-a68c-4028654f5f32', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927b6e40-b6d0-426a-aff2-58a5ad9112ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae.aaca8185-15b0-419b-9ea3-01f95fba1bd0" returned: 0 in 0.277s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:25 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 1073741824 Jul 24 12:58:25 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:25 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume volume-881786d8-85ab-4b04-a68c-4028654f5f32 (881786d8-85ab-4b04-a68c-4028654f5f32): created successfully Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (927b6e40-b6d0-426a-aff2-58a5ad9112ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (76ecb356-255b-490f-8c2a-4ab51347959f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-aaca8185-15b0-419b-9ea3-01f95fba1bd0" released by "_delete_snapshot" :: held 1.717s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5af29214-967b-467a-a2eb-d4eee5fc30a1 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created volume successfully. Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-6df4f403-3686-46ff-bcce-4638e83a0cae" released by "delete_snapshot" :: held 1.760s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Created reservations ['dfbca10d-52d7-498d-86db-d49d54b8a102', 'f873051c-59bc-4c4b-8b3c-e5a4b21cc1e7', '3dddb58f-5434-4dd3-8dac-4f4ccbd07b7f', '1721accb-0a8c-4812-babe-1b8f5c125e67'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:25 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Delete snapshot completed successfully. Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4dfde627-7c27-49d6-aba3-4de6ccaa342a tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-aaca8185-15b0-419b-9ea3-01f95fba1bd0-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:25 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 1073741824" returned: 0 in 0.529s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "cinder-6df4f403-3686-46ff-bcce-4638e83a0cae-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-6df4f403-3686-46ff-bcce-4638e83a0cae-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:25 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 Jul 24 12:58:25 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "cinder-quobyte-6df4f403-3686-46ff-bcce-4638e83a0cae" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-6df4f403-3686-46ff-bcce-4638e83a0cae" acquired by "delete_volume" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ed73e9-fca1-46b4-9778-4870a32f0508]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:26 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae Jul 24 12:58:26 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:26 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912" returned: 0 in 0.279s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.851s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-772749456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41fbf96-330a-4110-9d6c-f114211baa38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f43938d275cb4cf2849c17452213dd0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:19Z,use_quota=True,user_id='0939ae47607b454db282bd3ee5dcb5a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Creating volume e41fbf96-330a-4110-9d6c-f114211baa38 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:26 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9581c193-9629-424e-a901-65a3b6d97c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20a945c-9640-45b4-ad91-4bc10d4e3997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:26 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38 1073741824 Jul 24 12:58:26 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:26 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 (1f5c87fd-97e5-45c8-abf6-44125f4c6912): created successfully Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c20a945c-9640-45b4-ad91-4bc10d4e3997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (700c3367-c742-4d21-8429-5e6baa538e75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8241d2a6-d9ce-4f93-8c83-977c29351807 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created volume successfully. Jul 24 12:58:26 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae" returned: 0 in 0.367s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:26 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae Jul 24 12:58:26 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:26 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-6df4f403-3686-46ff-bcce-4638e83a0cae" returned: 0 in 0.285s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-6df4f403-3686-46ff-bcce-4638e83a0cae" released by "delete_volume" :: held 0.716s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:26 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38 1073741824" returned: 0 in 0.553s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Created reservations ['8ed319e1-615f-45c8-895b-5cb9caa72612', 'a8a3817b-5c67-4c9c-a31e-947b0366d7b3', '19b86103-1f38-4e06-8d79-a9aa2ea1befd', 'e49d22df-58f3-46f6-9dc7-75a33a168c0e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:26 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38 Jul 24 12:58:26 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:26 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:26 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "cinder-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:27 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38" returned: 0 in 0.326s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.052s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1979411319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6411524-2691-4d2f-afa7-c21b771fe940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486ef5e878c74cf4b24d1c4a7463916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:24Z,use_quota=True,user_id='69277db851bd4c108117f66a138fc0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Creating volume a6411524-2691-4d2f-afa7-c21b771fe940 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:27 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:27 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:27 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940 1073741824 Jul 24 12:58:27 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf698f01-0401-40c4-b063-4b1a1341179e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41fbf96-330a-4110-9d6c-f114211baa38', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300270fb-3942-4156-979e-9aea770e3e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.329s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Deleted volume successfully. Jul 24 12:58:27 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Volume volume-e41fbf96-330a-4110-9d6c-f114211baa38 (e41fbf96-330a-4110-9d6c-f114211baa38): created successfully Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (300270fb-3942-4156-979e-9aea770e3e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Flow 'volume_create_manager' (f0e2cc60-5494-47c0-8840-0ae23c4f35a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "cinder-quobyte-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:27 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fdcaf013-ac58-4e40-86e5-04fdb669b167 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created volume successfully. Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b6081c7c-9a91-4ac3-b292-65563b6234ac tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-6df4f403-3686-46ff-bcce-4638e83a0cae-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7028112e-3ce4-4860-9f4c-a9371822fcb1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:27 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b Jul 24 12:58:27 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:27 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940 1073741824" returned: 0 in 0.453s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:27 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940 Jul 24 12:58:27 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:27 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" returned: 0 in 0.407s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:27 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b Jul 24 12:58:27 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-e41fbf96-330a-4110-9d6c-f114211baa38-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-e41fbf96-330a-4110-9d6c-f114211baa38-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-quobyte-e41fbf96-330a-4110-9d6c-f114211baa38" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-e41fbf96-330a-4110-9d6c-f114211baa38" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:27 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940" returned: 0 in 0.349s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d015e4-5a51-4a2b-a1fe-9e8625cda220]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:27 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" returned: 0 in 0.328s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc82d1b8-90f3-42cb-b3b0-d83d6f6a21b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6411524-2691-4d2f-afa7-c21b771fe940', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed120aa-ca3b-4f3c-bb5f-455cb341491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-quobyte-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b" released by "delete_volume" :: held 0.801s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:27 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Volume volume-a6411524-2691-4d2f-afa7-c21b771fe940 (a6411524-2691-4d2f-afa7-c21b771fe940): created successfully Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ed120aa-ca3b-4f3c-bb5f-455cb341491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:27 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Flow 'volume_create_manager' (0d7bcf3a-2b87-4e64-a3ae-9eb19b628a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-21bfb2eb-57ac-4412-bdc2-97228d2509db tempest-ProjectReaderTests-819292704 None] Created volume successfully. Jul 24 12:58:28 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38 Jul 24 12:58:28 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Created reservations ['39c364f2-0615-4edc-b3e4-feb7f81b66df', 'dd037a70-7efd-40cd-95ba-3f4d9f0a9815', '937da9dd-8a52-4796-8fdb-181d89a56c93', 'd94eeee2-4338-48b2-a18f-6d285bbdb27a'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:28 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:28 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:28 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38" returned: 0 in 0.466s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:28 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38 Jul 24 12:58:28 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Acquiring lock "cinder-a6411524-2691-4d2f-afa7-c21b771fe940-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Lock "cinder-a6411524-2691-4d2f-afa7-c21b771fe940-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:28 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Acquiring lock "cinder-quobyte-a6411524-2691-4d2f-afa7-c21b771fe940" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.433s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Deleted volume successfully. Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Lock "cinder-quobyte-a6411524-2691-4d2f-afa7-c21b771fe940" acquired by "delete_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7c929f59-4c89-4b2a-a13e-0579990ef7bf tempest-VolumeDependencyTests-1792512718 None] Lock "cinder-4d91abb1-5b1b-4ce8-abd5-ac7f1a2c8c0b-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[589caab3-3204-4752-b8d8-6f7c926ead51]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:28 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-e41fbf96-330a-4110-9d6c-f114211baa38" returned: 0 in 0.357s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-e41fbf96-330a-4110-9d6c-f114211baa38" released by "delete_volume" :: held 0.878s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:28 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940 Jul 24 12:58:28 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created reservations ['67841472-d42a-4afa-94d3-4d863e72cfeb', '37f3e015-f980-497b-9456-fd73713c1026', 'a99eecf2-7da4-4cde-ba67-f34c0bd247f9', '6ad8bf9d-4f90-459a-87ee-958af283d68d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:28 devstack sudo[108650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:28 devstack sudo[108650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-1f5c87fd-97e5-45c8-abf6-44125f4c6912-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-1f5c87fd-97e5-45c8-abf6-44125f4c6912-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-quobyte-1f5c87fd-97e5-45c8-abf6-44125f4c6912" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-1f5c87fd-97e5-45c8-abf6-44125f4c6912" acquired by "delete_volume" :: waited 0.034s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:29 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940" returned: 0 in 0.513s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b664775-a340-4918-b9e1-8124b2da2449]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:29 devstack sudo[108656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940 Jul 24 12:58:29 devstack sudo[108656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:29 devstack sudo[108650]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.453s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Deleted volume successfully. Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-3aec2ed7-42fc-457b-b774-0e569cec819a tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-e41fbf96-330a-4110-9d6c-f114211baa38-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:29 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 Jul 24 12:58:29 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:29 devstack sudo[108656]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a6411524-2691-4d2f-afa7-c21b771fe940" returned: 0 in 0.416s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Lock "cinder-quobyte-a6411524-2691-4d2f-afa7-c21b771fe940" released by "delete_volume" :: held 1.003s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Flow 'volume_create_manager' (fb676e1d-4590-411c-b506-ed3271d7cd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:29 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1003bf28-63d6-4a66-822c-6a995d525a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912" returned: 0 in 0.533s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1003bf28-63d6-4a66-822c-6a995d525a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4d4b06-7ba9-4a28-80c7-06c2d2001559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bcc0a71a3249c89e77171ff2e211a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:30Z,use_quota=True,user_id='1c1067f23b8b4032aae81c3d08af57d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65392e64-1d39-4f10-8c8a-f61eb244be2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:29 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912 Jul 24 12:58:29 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65392e64-1d39-4f10-8c8a-f61eb244be2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fc8ab8-73d2-4728-841c-70789b43857a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.image.glance [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Creating Keystone auth plugin from conf {{(pid=88540) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Created reservations ['6cca424b-a7bd-418b-8376-716fb8af3987', '75d642ca-e46b-4434-ac99-696aae684f3a', 'be4e9618-feb6-4698-a7f8-214fff7cbc5b', 'a5e97b8c-43ab-4b46-af48-0e5c7878d32b'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:29 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:29 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:30 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1f5c87fd-97e5-45c8-abf6-44125f4c6912" returned: 0 in 0.436s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-1f5c87fd-97e5-45c8-abf6-44125f4c6912" released by "delete_volume" :: held 1.040s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:30 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.326s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Deleted volume successfully. Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created reservations ['9fe69a65-e263-4ead-b93c-ff1649d89b4f', 'e48af9e3-d80f-45fc-a0bf-8299fdb9dc94', '446a12d4-b28d-4d7b-a782-17d46cb549cf', '2a48820c-90ab-412e-b83c-d8345352fc11'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ecee92be-baf1-4479-a2d8-4b05d17079a0 tempest-ProjectReaderTests-819292704 None] Lock "cinder-a6411524-2691-4d2f-afa7-c21b771fe940-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fc8ab8-73d2-4728-841c-70789b43857a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2a4d4b06-7ba9-4a28-80c7-06c2d2001559', 'volume_name': 'volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559', 'volume_size': 1, 'image_id': '8daae189-5c08-446b-97c5-58a6dd1d8615', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8daae189-5c08-446b-97c5-58a6dd1d8615', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dd0ef885b287604b95e28c33fd3337d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37bcc0a71a3249c89e77171ff2e211a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42fc284de2c1e11579b4c77c8ba79ac83f39e5e867d8184a831bc8af8978cb87484baf891d208e94bde98a378e1a6f0a8cf9b9d7ed7415961e6e085bc179fec3', 'id': '8daae189-5c08-446b-97c5-58a6dd1d8615', 'created_at': datetime.datetime(2026, 7, 24, 10, 58, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 58, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8daae189-5c08-446b-97c5-58a6dd1d8615/file', 'properties': {}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07789ee-fffb-4ea8-afbe-84298c705c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d07789ee-fffb-4ea8-afbe-84298c705c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eebd619-2d25-4343-8e2c-364d8ec7d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:30 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Volume 2a4d4b06-7ba9-4a28-80c7-06c2d2001559: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559', 'volume_size': 1, 'image_id': '8daae189-5c08-446b-97c5-58a6dd1d8615', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8daae189-5c08-446b-97c5-58a6dd1d8615', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dd0ef885b287604b95e28c33fd3337d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37bcc0a71a3249c89e77171ff2e211a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42fc284de2c1e11579b4c77c8ba79ac83f39e5e867d8184a831bc8af8978cb87484baf891d208e94bde98a378e1a6f0a8cf9b9d7ed7415961e6e085bc179fec3', 'id': '8daae189-5c08-446b-97c5-58a6dd1d8615', 'created_at': datetime.datetime(2026, 7, 24, 10, 58, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 58, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8daae189-5c08-446b-97c5-58a6dd1d8615/file', 'properties': {}}, 'image_service': } Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Trying to clone 2a4d4b06-7ba9-4a28-80c7-06c2d2001559 from image 8daae189-5c08-446b-97c5-58a6dd1d8615 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8daae189-5c08-446b-97c5-58a6dd1d8615', 'metadata': {}}]). {{(pid=88540) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:30 devstack sudo[108672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:30 devstack sudo[108672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 12:58:30 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Image download 0.00 MB at 0.00 MB/s Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95e3fb7-73b9-4d93-abd7-ed969c9dbdb4]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:30 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD Jul 24 12:58:30 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:30 devstack sudo[108672]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.283s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:30 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Deleted volume successfully. Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-536f993d-afec-450f-9d81-7a758e9a1019 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-1f5c87fd-97e5-45c8-abf6-44125f4c6912-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:30 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:31 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD Jul 24 12:58:31 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:31 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Temporary image 8daae189-5c08-446b-97c5-58a6dd1d8615 is fetched for user 1c1067f23b8b4032aae81c3d08af57d4. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Flow 'volume_create_manager' (38b8f3bc-d11c-4e6c-bdd4-b6ec15f0538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325235b6-e773-4fdd-bab1-fb5346181884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-881786d8-85ab-4b04-a68c-4028654f5f32-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (325235b6-e773-4fdd-bab1-fb5346181884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1401329567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e78db1-c892-4c40-94f9-cb9ae21d6b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486ef5e878c74cf4b24d1c4a7463916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:31Z,use_quota=True,user_id='69277db851bd4c108117f66a138fc0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8dfef6-269f-4d5a-af15-93fae48788bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca8dfef6-269f-4d5a-af15-93fae48788bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33771ab-edea-4dd4-b6e1-9be5f08b329e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b33771ab-edea-4dd4-b6e1-9be5f08b329e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e78db1-c892-4c40-94f9-cb9ae21d6b8c', 'volume_name': 'volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12239c90-7afa-42b7-909b-df4f709a24af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12239c90-7afa-42b7-909b-df4f709a24af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e922458c-0946-447d-8ebd-14c651ec05c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:31 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Volume 86e78db1-c892-4c40-94f9-cb9ae21d6b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c', 'volume_size': 1} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1401329567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e78db1-c892-4c40-94f9-cb9ae21d6b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486ef5e878c74cf4b24d1c4a7463916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:31Z,use_quota=True,user_id='69277db851bd4c108117f66a138fc0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Creating volume 86e78db1-c892-4c40-94f9-cb9ae21d6b8c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:31 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-881786d8-85ab-4b04-a68c-4028654f5f32-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:31 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c 1073741824 Jul 24 12:58:31 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[522bf6fb-1449-4eb7-8c84-e5fa590a7a1e]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-quobyte-881786d8-85ab-4b04-a68c-4028654f5f32" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-881786d8-85ab-4b04-a68c-4028654f5f32" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f520f8-8c68-49d9-a4a1-05f3f6a5ae86]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:31 devstack sudo[108686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD Jul 24 12:58:31 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32 Jul 24 12:58:31 devstack sudo[108686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:31 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:31 devstack sudo[108686]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:31 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c 1073741824" returned: 0 in 0.526s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:31 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32" returned: 0 in 0.453s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:32 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c Jul 24 12:58:32 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:32 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD Jul 24 12:58:32 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:32 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32 Jul 24 12:58:32 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:32 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-881786d8-85ab-4b04-a68c-4028654f5f32" returned: 0 in 0.285s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:32 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c" returned: 0 in 0.310s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-881786d8-85ab-4b04-a68c-4028654f5f32" released by "delete_volume" :: held 0.799s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e922458c-0946-447d-8ebd-14c651ec05c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea0e809-2769-428b-abba-af03f9343a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:32 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD" returned: 1 in 0.440s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4d4b06-7ba9-4a28-80c7-06c2d2001559,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37bcc0a71a3249c89e77171ff2e211a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:30Z,use_quota=True,user_id='1c1067f23b8b4032aae81c3d08af57d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Creating volume 2a4d4b06-7ba9-4a28-80c7-06c2d2001559 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:32 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-93d5541b-399a-4c7d-8015-8feffdfaa699 tempest-ProjectAdminTests-75157011 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88540) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 12:58:32 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Volume volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c (86e78db1-c892-4c40-94f9-cb9ae21d6b8c): created successfully Jul 24 12:58:32 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 1073741824 Jul 24 12:58:32 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea0e809-2769-428b-abba-af03f9343a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Flow 'volume_create_manager' (38b8f3bc-d11c-4e6c-bdd4-b6ec15f0538c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6ebc0707-30dd-49db-86f9-5e454e4d81b7 tempest-ProjectReaderTests-819292704 None] Created volume successfully. Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created reservations ['19af4d3d-2a44-415c-9344-5a398579cd44', '2a0bb2a8-aada-49c0-b85c-a3071f766e40', '13427261-07cf-4117-a144-3136f6485ced', 'af10f2e3-d5b0-46c2-9de6-3866e0578a0a'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:32 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:32 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:32 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.290s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Deleted volume successfully. Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cbbc41c6-b7c2-43e1-b82b-2610d91f0dae tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-881786d8-85ab-4b04-a68c-4028654f5f32-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:32 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 1073741824" returned: 0 in 0.508s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:32 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 Jul 24 12:58:32 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:33 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559" returned: 0 in 0.268s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Attempting download of 8daae189-5c08-446b-97c5-58a6dd1d8615 ((None, [{'url': 'file:///opt/stack/data/glance/images/8daae189-5c08-446b-97c5-58a6dd1d8615', 'metadata': {}}])) to volume 2a4d4b06-7ba9-4a28-80c7-06c2d2001559. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c1159-9030-4ec0-b620-47e937c3f40b]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8daae189-5c08-446b-97c5-58a6dd1d8615_vozkxrwc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:33 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8daae189-5c08-446b-97c5-58a6dd1d8615_vozkxrwc Jul 24 12:58:33 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-a13e805f-6be7-4ef5-ac57-837c5298805c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:33 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8daae189-5c08-446b-97c5-58a6dd1d8615_vozkxrwc" returned: 0 in 0.370s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8daae189-5c08-446b-97c5-58a6dd1d8615_vozkxrwc {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-a13e805f-6be7-4ef5-ac57-837c5298805c-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-quobyte-a13e805f-6be7-4ef5-ac57-837c5298805c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-a13e805f-6be7-4ef5-ac57-837c5298805c" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[72315e0f-a0e2-4eed-9bb2-176152887b3a]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:33 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8daae189-5c08-446b-97c5-58a6dd1d8615_vozkxrwc Jul 24 12:58:33 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Acquiring lock "cinder-86e78db1-c892-4c40-94f9-cb9ae21d6b8c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Lock "cinder-86e78db1-c892-4c40-94f9-cb9ae21d6b8c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Acquiring lock "cinder-quobyte-86e78db1-c892-4c40-94f9-cb9ae21d6b8c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Lock "cinder-quobyte-86e78db1-c892-4c40-94f9-cb9ae21d6b8c" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:33 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c Jul 24 12:58:33 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[565e5186-7b8c-4da1-b7f0-0a56147cce9f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:34 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8daae189-5c08-446b-97c5-58a6dd1d8615_vozkxrwc" returned: 1 in 0.491s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8daae189-5c08-446b-97c5-58a6dd1d8615_vozkxrwc' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ea0358-29d7-49de-9dbf-d1bb00ea8d74]: (4, 'raw') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:34 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c Jul 24 12:58:34 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:34 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD Jul 24 12:58:34 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:34 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c" returned: 0 in 0.501s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:34 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c Jul 24 12:58:34 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:34 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c" returned: 0 in 0.437s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:34 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c Jul 24 12:58:34 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:34 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:34 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-a13e805f-6be7-4ef5-ac57-837c5298805c" returned: 0 in 0.294s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-a13e805f-6be7-4ef5-ac57-837c5298805c" released by "delete_volume" :: held 0.858s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created reservations ['d36e7b8d-f71d-4b0e-87ec-e8c4956e2b4b', '33dc0356-0d9d-4194-aaa2-aaa520ef1047', '08706104-5d33-46c8-a6fe-f0298a59dfe2', '2347eff7-f9b5-447d-9ae1-df5f4a33078c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:34 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD Jul 24 12:58:34 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:34 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-86e78db1-c892-4c40-94f9-cb9ae21d6b8c" returned: 0 in 0.336s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Lock "cinder-quobyte-86e78db1-c892-4c40-94f9-cb9ae21d6b8c" released by "delete_volume" :: held 0.842s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:34 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:34 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-bcb60802-196a-4363-9869-82be0de53d95-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-bcb60802-196a-4363-9869-82be0de53d95-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Created reservations ['eaa12007-fc4a-4750-a942-22cac14170b7', 'e240e043-9c20-43f9-a7d4-8893f2a71c3d', '2ef1b8b3-5a9a-4d02-8c82-42f25499898d', '5326bf11-c547-437b-8594-fa97ef8e9747'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-quobyte-bcb60802-196a-4363-9869-82be0de53d95" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-bcb60802-196a-4363-9869-82be0de53d95" acquired by "delete_volume" :: waited 0.046s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:35 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD" returned: 1 in 0.520s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD' failed. Not Retrying. {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] 8daae189-5c08-446b-97c5-58a6dd1d8615 was raw, converting to qcow2 {{(pid=88540) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae07468a-6291-4417-8577-be0cda128272]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:35 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 Jul 24 12:58:35 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:35 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:35 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:35 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.540s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:35 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Deleted volume successfully. Jul 24 12:58:35 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95 Jul 24 12:58:35 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7649ade3-d9e3-4f4a-ac1c-4142b83301bd tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-a13e805f-6be7-4ef5-ac57-837c5298805c-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:35 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.420s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:35 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Deleted volume successfully. Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-981a8fc5-2b0b-4679-a144-060e0ff03d97 tempest-ProjectReaderTests-819292704 None] Lock "cinder-86e78db1-c892-4c40-94f9-cb9ae21d6b8c-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:35 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559" returned: 0 in 0.662s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8daae189-5c08-446b-97c5-58a6dd1d8615_iuw_mw4idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:58:35 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:35 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95" returned: 0 in 0.655s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:35 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 1G Jul 24 12:58:35 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:35 devstack sudo[108775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95 Jul 24 12:58:35 devstack sudo[108775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Flow 'volume_create_manager' (e9027379-2fdc-45ef-8749-4db1f21612f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31838a55-9424-4441-92ce-06d70504c091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31838a55-9424-4441-92ce-06d70504c091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1521211317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b379a8-fee5-4fa2-be2b-5eb6e9b322c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486ef5e878c74cf4b24d1c4a7463916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:36Z,use_quota=True,user_id='69277db851bd4c108117f66a138fc0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57528830-2a8e-4ad2-95de-6f562ee4d9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57528830-2a8e-4ad2-95de-6f562ee4d9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a790b9-906a-4e97-b0a8-fe7de5523b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82a790b9-906a-4e97-b0a8-fe7de5523b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b379a8-fee5-4fa2-be2b-5eb6e9b322c0', 'volume_name': 'volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460a725b-7a25-4f2e-95a2-baf87564a3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460a725b-7a25-4f2e-95a2-baf87564a3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae1ce84-90d9-4e56-8210-43bb915a3612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:35 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Volume 75b379a8-fee5-4fa2-be2b-5eb6e9b322c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0', 'volume_size': 1} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1521211317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b379a8-fee5-4fa2-be2b-5eb6e9b322c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486ef5e878c74cf4b24d1c4a7463916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:36Z,use_quota=True,user_id='69277db851bd4c108117f66a138fc0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Creating volume 75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:35 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:35 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 1073741824 Jul 24 12:58:35 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:36 devstack sudo[108775]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-bcb60802-196a-4363-9869-82be0de53d95" returned: 0 in 0.286s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-bcb60802-196a-4363-9869-82be0de53d95" released by "delete_volume" :: held 1.048s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created reservations ['807cbdbe-2f90-4284-a475-8c8172dd436a', '8253f11a-08b6-4ac1-9e5e-cc64f203bcd2', '0419ac55-b755-4254-bb47-02f90e4fa5d7', 'ba148c70-5e97-484a-86bb-07ce753fba2f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:36 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 1G" returned: 0 in 0.459s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Downloaded image 8daae189-5c08-446b-97c5-58a6dd1d8615 ((None, [{'url': 'file:///opt/stack/data/glance/images/8daae189-5c08-446b-97c5-58a6dd1d8615', 'metadata': {}}])) to volume 2a4d4b06-7ba9-4a28-80c7-06c2d2001559 successfully. {{(pid=88540) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Temporary image 8daae189-5c08-446b-97c5-58a6dd1d8615 for user 1c1067f23b8b4032aae81c3d08af57d4 is deleted. {{(pid=88540) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.volume_utils [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Marking volume 2a4d4b06-7ba9-4a28-80c7-06c2d2001559 as bootable. {{(pid=88540) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Copying metadata from image 8daae189-5c08-446b-97c5-58a6dd1d8615 to 2a4d4b06-7ba9-4a28-80c7-06c2d2001559. {{(pid=88540) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Creating volume glance metadata for volume 2a4d4b06-7ba9-4a28-80c7-06c2d2001559 backed by image 8daae189-5c08-446b-97c5-58a6dd1d8615 with: {'image_id': '8daae189-5c08-446b-97c5-58a6dd1d8615', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4dd0ef885b287604b95e28c33fd3337d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88540) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:36 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:36 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eebd619-2d25-4343-8e2c-364d8ec7d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559', 'volume_size': 1, 'image_id': '8daae189-5c08-446b-97c5-58a6dd1d8615', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8daae189-5c08-446b-97c5-58a6dd1d8615', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4dd0ef885b287604b95e28c33fd3337d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37bcc0a71a3249c89e77171ff2e211a7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '42fc284de2c1e11579b4c77c8ba79ac83f39e5e867d8184a831bc8af8978cb87484baf891d208e94bde98a378e1a6f0a8cf9b9d7ed7415961e6e085bc179fec3', 'id': '8daae189-5c08-446b-97c5-58a6dd1d8615', 'created_at': datetime.datetime(2026, 7, 24, 10, 58, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 10, 58, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8daae189-5c08-446b-97c5-58a6dd1d8615/file', 'properties': {}}, 'image_service': }' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ce2565-09ac-4fee-8393-2770582ccb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:36 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Volume volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 (2a4d4b06-7ba9-4a28-80c7-06c2d2001559): created successfully Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ce2565-09ac-4fee-8393-2770582ccb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Flow 'volume_create_manager' (fb676e1d-4590-411c-b506-ed3271d7cd56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-2628b06c-cc94-4eda-be42-fc23d45c57c5 tempest-VolumeImageDependencyTests-527929050 None] Created volume successfully. Jul 24 12:58:36 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 1073741824" returned: 0 in 0.547s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:36 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 Jul 24 12:58:36 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:36 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.312s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Deleted volume successfully. Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-29bb962d-e359-4579-874f-9673d895b5b8 tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-bcb60802-196a-4363-9869-82be0de53d95-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:36 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0" returned: 0 in 0.266s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae1ce84-90d9-4e56-8210-43bb915a3612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09a10ce-e042-4e6d-aa3d-395eb7efba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:36 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Volume volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 (75b379a8-fee5-4fa2-be2b-5eb6e9b322c0): created successfully Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09a10ce-e042-4e6d-aa3d-395eb7efba0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:36 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Flow 'volume_create_manager' (e9027379-2fdc-45ef-8749-4db1f21612f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-54412d06-fcdf-49e9-a7da-bdc9a08b58bf tempest-ProjectReaderTests-819292704 None] Created volume successfully. Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "cinder-quobyte-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a509ef38-8966-4062-82ef-ba8dbb7f0115]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Acquiring lock "cinder-2a4d4b06-7ba9-4a28-80c7-06c2d2001559-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Lock "cinder-2a4d4b06-7ba9-4a28-80c7-06c2d2001559-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Acquiring lock "cinder-quobyte-2a4d4b06-7ba9-4a28-80c7-06c2d2001559" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Lock "cinder-quobyte-2a4d4b06-7ba9-4a28-80c7-06c2d2001559" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:37 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 Jul 24 12:58:37 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9284b6e7-6627-4e9d-942c-93aec9591eac]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:37 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 Jul 24 12:58:37 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:37 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2" returned: 0 in 0.363s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:37 devstack sudo[108801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2 Jul 24 12:58:37 devstack sudo[108801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:37 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559" returned: 0 in 0.372s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:37 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559 Jul 24 12:58:37 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:37 devstack sudo[108801]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2" returned: 0 in 0.256s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Acquiring lock "cinder-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-quobyte-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2" released by "delete_volume" :: held 0.726s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:37 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Lock "cinder-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Created reservations ['d10a4fd5-e712-4232-b377-11afd8058627', 'ebcb7acf-32e8-463c-b13f-7aeddbeabc15', 'bd60fc2f-253b-4569-ab98-9347aa3e2a26', '282c83df-b499-4845-871d-40a474580b3f'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Acquiring lock "cinder-quobyte-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:38 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-2a4d4b06-7ba9-4a28-80c7-06c2d2001559" returned: 0 in 0.303s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Lock "cinder-quobyte-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0" acquired by "delete_volume" :: waited 0.037s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Lock "cinder-quobyte-2a4d4b06-7ba9-4a28-80c7-06c2d2001559" released by "delete_volume" :: held 0.737s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d8a8fb-1be9-4abd-a0b4-9d7439538161]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Created reservations ['057d4d2a-7a46-481b-8746-d3e7fa5531ae', '1cfc40f8-1e2c-4c32-aa6d-928b8d323c64', 'f4dc0efa-0d5e-476f-9b41-313df727898f', '6f5d11c2-d9c6-4ec0-8f49-2d65032d4dbe'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:38 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:38 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:38 devstack sudo[108810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 Jul 24 12:58:38 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:38 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:38 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:38 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.474s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Deleted volume successfully. Jul 24 12:58:38 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0" returned: 0 in 0.569s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:38 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-75cac648-a7cf-41ca-9307-e327ce47bdef tempest-CreateVolumesFromSourceVolumeTest-1872651426 None] Lock "cinder-1ac50d84-66f9-4b9e-b5cf-6ec27e30a6f2-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.409s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:38 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Deleted volume successfully. Jul 24 12:58:38 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0 Jul 24 12:58:38 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-052e737c-5fea-454d-bb56-485f2d297d0d tempest-VolumeImageDependencyTests-527929050 None] Lock "cinder-2a4d4b06-7ba9-4a28-80c7-06c2d2001559-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:39 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0" returned: 0 in 0.368s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Lock "cinder-quobyte-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0" released by "delete_volume" :: held 1.005s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Created reservations ['510fd879-f0dd-4a61-b2a9-7c2a9a74b325', '9368efa5-9827-4607-9dd9-2812ed1c235e', '33f70ae1-3199-4abc-8125-1cb708c2c2da', '35447b56-4e96-45af-bcac-ce616f7095c1'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:39 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:39 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:39 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.337s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:39 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Deleted volume successfully. Jul 24 12:58:39 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-239a2e09-691d-4404-9731-05445c157e3c tempest-ProjectReaderTests-819292704 None] Lock "cinder-75b379a8-fee5-4fa2-be2b-5eb6e9b322c0-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Flow 'volume_create_manager' (f2a603ef-0023-4b56-90da-8fd50e9bb472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7b5f86-b820-460b-b6dd-43bb5288bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7b5f86-b820-460b-b6dd-43bb5288bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145603327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98779fb9-a332-4812-8bde-6b92829c9e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486ef5e878c74cf4b24d1c4a7463916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:41Z,use_quota=True,user_id='69277db851bd4c108117f66a138fc0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f3abf4-c5d5-4c06-87e3-c1b584cc91d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f3abf4-c5d5-4c06-87e3-c1b584cc91d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76333a73-22be-4b5b-aaab-ef292ce7b644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76333a73-22be-4b5b-aaab-ef292ce7b644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98779fb9-a332-4812-8bde-6b92829c9e07', 'volume_name': 'volume-98779fb9-a332-4812-8bde-6b92829c9e07', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d123d740-ec94-41f1-a92a-64a54469e3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d123d740-ec94-41f1-a92a-64a54469e3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e789c6a-f1f9-4d15-b88b-008922205242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:40 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Volume 98779fb9-a332-4812-8bde-6b92829c9e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98779fb9-a332-4812-8bde-6b92829c9e07', 'volume_size': 1} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2145603327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98779fb9-a332-4812-8bde-6b92829c9e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='486ef5e878c74cf4b24d1c4a7463916c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:41Z,use_quota=True,user_id='69277db851bd4c108117f66a138fc0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Creating volume 98779fb9-a332-4812-8bde-6b92829c9e07 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:40 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:40 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07 1073741824 Jul 24 12:58:40 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:41 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07 1073741824" returned: 0 in 0.603s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:41 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07 Jul 24 12:58:41 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:41 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07" returned: 0 in 0.301s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e789c6a-f1f9-4d15-b88b-008922205242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98779fb9-a332-4812-8bde-6b92829c9e07', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd63f58-9eb1-4656-9cc1-a7be5e671546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:41 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Volume volume-98779fb9-a332-4812-8bde-6b92829c9e07 (98779fb9-a332-4812-8bde-6b92829c9e07): created successfully Jul 24 12:58:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd63f58-9eb1-4656-9cc1-a7be5e671546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:41 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Flow 'volume_create_manager' (f2a603ef-0023-4b56-90da-8fd50e9bb472) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:41 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-42de680b-f359-44f2-b7cb-ae6422a7cc37 tempest-ProjectReaderTests-819292704 None] Created volume successfully. Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:42 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:42 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:42 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.280s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:58:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Acquiring lock "cinder-98779fb9-a332-4812-8bde-6b92829c9e07-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Lock "cinder-98779fb9-a332-4812-8bde-6b92829c9e07-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Acquiring lock "cinder-quobyte-98779fb9-a332-4812-8bde-6b92829c9e07" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Lock "cinder-quobyte-98779fb9-a332-4812-8bde-6b92829c9e07" acquired by "delete_volume" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae97ed5-f5b0-4771-9b7f-a59ab35fb84c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:43 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07 Jul 24 12:58:43 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (c7680268-a4d5-4378-a8c9-0b48c3e94588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08056a1a-1109-4976-8c4d-8d05a614ef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08056a1a-1109-4976-8c4d-8d05a614ef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128121111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690df452-fe16-489d-b1cb-c606ea7f0f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:43Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6fd39d-1154-4460-80d1-487446b28d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6fd39d-1154-4460-80d1-487446b28d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a463a6-5cb9-44c1-b84d-051f4adad858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6a463a6-5cb9-44c1-b84d-051f4adad858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '690df452-fe16-489d-b1cb-c606ea7f0f9f', 'volume_name': 'volume-690df452-fe16-489d-b1cb-c606ea7f0f9f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4982970a-75bc-4db7-9839-dbb388ec1b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4982970a-75bc-4db7-9839-dbb388ec1b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2454238e-23ff-4455-831a-7fa698c3946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:43 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Volume 690df452-fe16-489d-b1cb-c606ea7f0f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-690df452-fe16-489d-b1cb-c606ea7f0f9f', 'volume_size': 1} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-128121111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=690df452-fe16-489d-b1cb-c606ea7f0f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:43Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Creating volume 690df452-fe16-489d-b1cb-c606ea7f0f9f {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:43 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:43 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f 1073741824 Jul 24 12:58:43 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:43 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07" returned: 0 in 0.485s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:43 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07 Jul 24 12:58:43 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:44 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f 1073741824" returned: 0 in 0.566s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:44 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-98779fb9-a332-4812-8bde-6b92829c9e07" returned: 0 in 0.381s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Lock "cinder-quobyte-98779fb9-a332-4812-8bde-6b92829c9e07" released by "delete_volume" :: held 0.921s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:44 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f Jul 24 12:58:44 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Created reservations ['3d5e0be3-14ee-4c00-a6bc-1fa1ef35bc8c', 'ed5fdd13-8707-4c9d-882f-8600a1faf878', 'fd6f237e-3ef8-4df1-baac-11fdba7c3428', 'c02c2e48-496f-4252-a11e-b87a69495b90'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:44 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:44 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:44 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f" returned: 0 in 0.364s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2454238e-23ff-4455-831a-7fa698c3946e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-690df452-fe16-489d-b1cb-c606ea7f0f9f', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abef67f1-661e-4e4e-8a77-3668951d7ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:44 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Volume volume-690df452-fe16-489d-b1cb-c606ea7f0f9f (690df452-fe16-489d-b1cb-c606ea7f0f9f): created successfully Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abef67f1-661e-4e4e-8a77-3668951d7ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (c7680268-a4d5-4378-a8c9-0b48c3e94588) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0ff21f9e-0368-49c6-aad7-224c743f285e tempest-ProjectReaderTests-866179016 None] Created volume successfully. Jul 24 12:58:44 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.277s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:44 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Deleted volume successfully. Jul 24 12:58:44 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-10e8d6a3-5c7b-4c06-965e-3a05cfa66a8b tempest-ProjectReaderTests-819292704 None] Lock "cinder-98779fb9-a332-4812-8bde-6b92829c9e07-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:45 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Creating offline snapshot 9f9779f4-1083-46f3-9f05-8fb569c5f23c of volume 690df452-fe16-489d-b1cb-c606ea7f0f9f {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:58:45 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a65e30-5206-4170-8d13-0a5c3c409e06]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:45 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f Jul 24 12:58:45 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:46 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f" returned: 0 in 0.394s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:46 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c 1G Jul 24 12:58:46 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:46 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c 1G" returned: 0 in 0.495s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-690df452-fe16-489d-b1cb-c606ea7f0f9f -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:46 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-690df452-fe16-489d-b1cb-c606ea7f0f9f -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c Jul 24 12:58:46 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:47 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-690df452-fe16-489d-b1cb-c606ea7f0f9f -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c" returned: 0 in 0.384s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:47 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c is being set with open permissions: ugo+rw Jul 24 12:58:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:47 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c Jul 24 12:58:47 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:47 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c" returned: 0 in 0.291s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:47 devstack sudo[108880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.info Jul 24 12:58:47 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:47 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.info" returned: 0 in 0.299s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:47 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.info is being set with open permissions: ugo+rw Jul 24 12:58:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:47 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.info Jul 24 12:58:47 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:48 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.info" returned: 0 in 0.280s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9a30cdb4-3fad-42c3-a38c-305b77275eca tempest-ProjectReaderTests-866179016 None] Create snapshot completed successfully Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (3b5cfe0e-58ad-4841-9d5f-5e324e5dec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a1614e-b939-4ded-b4f3-3d0f91f55f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a1614e-b939-4ded-b4f3-3d0f91f55f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264545901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367ed6b8-1563-4df2-8ea5-ce0b45a6df4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:49Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41462b64-169d-4e06-bbef-cfea4783a956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41462b64-169d-4e06-bbef-cfea4783a956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea36619-a463-421b-9a6d-30b239a5f293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea36619-a463-421b-9a6d-30b239a5f293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '367ed6b8-1563-4df2-8ea5-ce0b45a6df4d', 'volume_name': 'volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa322ed-fe35-4ea4-99f9-9666869ce0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa322ed-fe35-4ea4-99f9-9666869ce0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61435a73-3f7a-448c-b7bc-4ac322f77d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:48 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Volume 367ed6b8-1563-4df2-8ea5-ce0b45a6df4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d', 'volume_size': 1} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-264545901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367ed6b8-1563-4df2-8ea5-ce0b45a6df4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:49Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Creating volume 367ed6b8-1563-4df2-8ea5-ce0b45a6df4d {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:48 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:48 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d 1073741824 Jul 24 12:58:48 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-9f9779f4-1083-46f3-9f05-8fb569c5f23c-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Lock "cinder-9f9779f4-1083-46f3-9f05-8fb569c5f23c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-690df452-fe16-489d-b1cb-c606ea7f0f9f" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-690df452-fe16-489d-b1cb-c606ea7f0f9f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-9f9779f4-1083-46f3-9f05-8fb569c5f23c" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:49 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d 1073741824" returned: 0 in 0.625s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=332,cinder:SELECT=245,cinder:INSERT=78,cinder:DELETE=25 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-9f9779f4-1083-46f3-9f05-8fb569c5f23c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Deleting offline snapshot 9f9779f4-1083-46f3-9f05-8fb569c5f23c of volume 690df452-fe16-489d-b1cb-c606ea7f0f9f {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] snapshot_file for this snap is: volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3dd4d5-5eec-445a-9ea2-7f635b0a00a3]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:49 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d Jul 24 12:58:49 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:49 devstack sudo[108893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c Jul 24 12:58:49 devstack sudo[108893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:49 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" returned: 0 in 0.288s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=225,cinder:UPDATE=322,cinder:DELETE=34,cinder:INSERT=93 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61435a73-3f7a-448c-b7bc-4ac322f77d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8a228-f265-4c86-ae98-0862b1957aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:49 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Volume volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d (367ed6b8-1563-4df2-8ea5-ce0b45a6df4d): created successfully Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5a8a228-f265-4c86-ae98-0862b1957aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (3b5cfe0e-58ad-4841-9d5f-5e324e5dec45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:49 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-63a943c2-ac13-4359-8c11-09bb8cdbc356 tempest-ProjectMemberTests-2053079969 None] Created volume successfully. Jul 24 12:58:49 devstack sudo[108893]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c" returned: 0 in 0.514s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:49 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-690df452-fe16-489d-b1cb-c606ea7f0f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:58:50 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc93a216-5888-4496-a394-c08a3d168946]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:50 devstack sudo[108902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f Jul 24 12:58:50 devstack sudo[108902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:50 devstack sudo[108902]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f" returned: 0 in 0.405s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:50 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c Jul 24 12:58:50 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:50 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c" returned: 0 in 0.447s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:50 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c Jul 24 12:58:50 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:51 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f.9f9779f4-1083-46f3-9f05-8fb569c5f23c" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-9f9779f4-1083-46f3-9f05-8fb569c5f23c" released by "_delete_snapshot" :: held 1.748s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-690df452-fe16-489d-b1cb-c606ea7f0f9f" released by "delete_snapshot" :: held 1.782s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Created reservations ['03ba515a-beb5-4e8c-bf52-4d0406f362c2', '32b91528-0784-471e-ae12-27a96935efde', '5e081a8d-4943-4a26-a878-f405e4079714', '68fb8db9-48fb-4c09-83d4-33758a6c2436'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Creating offline snapshot c363da29-9f35-4b82-9bae-6d4e71bc7600 of volume 367ed6b8-1563-4df2-8ea5-ce0b45a6df4d {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:58:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Delete snapshot completed successfully. Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-d0f39b08-7300-4c60-b3a2-7393c9be3406 tempest-ProjectReaderTests-866179016 None] Lock "cinder-9f9779f4-1083-46f3-9f05-8fb569c5f23c-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8016908a-8ff8-4731-abf9-4aa27279458f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-690df452-fe16-489d-b1cb-c606ea7f0f9f-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:51 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d Jul 24 12:58:51 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Lock "cinder-690df452-fe16-489d-b1cb-c606ea7f0f9f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-690df452-fe16-489d-b1cb-c606ea7f0f9f" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-690df452-fe16-489d-b1cb-c606ea7f0f9f" acquired by "delete_volume" :: waited 0.022s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c409b506-4496-44d2-a30a-d6bde36325b6]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:51 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f Jul 24 12:58:51 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:51 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" returned: 0 in 0.516s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:51 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 1G Jul 24 12:58:51 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:52 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f" returned: 0 in 0.455s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:52 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f Jul 24 12:58:52 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:52 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 1G" returned: 0 in 0.475s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:52 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 Jul 24 12:58:52 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:52 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-690df452-fe16-489d-b1cb-c606ea7f0f9f" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-690df452-fe16-489d-b1cb-c606ea7f0f9f" released by "delete_volume" :: held 0.884s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Created reservations ['c403581a-c05d-48c4-ae86-c9c935274c59', '8ff04a1c-9ab3-4eeb-8a52-d2277850d94d', '3401d91a-0cba-49b8-9365-82a195669edb', 'ee436b5d-b8cb-49d3-ac20-8d1f4b149aed'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:52 devstack sudo[108940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:52 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:52 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600" returned: 0 in 0.387s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:52 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 is being set with open permissions: ugo+rw Jul 24 12:58:52 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:52 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 Jul 24 12:58:52 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:53 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.366s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:53 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Deleted volume successfully. Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-cd798212-e467-4d93-8092-7c9ac5746413 tempest-ProjectReaderTests-866179016 None] Lock "cinder-690df452-fe16-489d-b1cb-c606ea7f0f9f-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:53 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600" returned: 0 in 0.408s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:53 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.info Jul 24 12:58:53 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (b8fdfdaf-12a9-4c79-942e-d725f31b3a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc10781-10d4-4512-a0e6-187b534b13ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc10781-10d4-4512-a0e6-187b534b13ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169892284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5af556-5e5f-4afa-b232-c5f80d1a6867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:53Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c181b8bd-5324-40c8-ab2f-9291e04a6cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c181b8bd-5324-40c8-ab2f-9291e04a6cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd2417b-bcdc-4155-8927-dcfb3d097957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fd2417b-bcdc-4155-8927-dcfb3d097957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e5af556-5e5f-4afa-b232-c5f80d1a6867', 'volume_name': 'volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6238a59c-e7ce-4f28-9cae-01ad76bb9711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6238a59c-e7ce-4f28-9cae-01ad76bb9711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5996de05-3338-4124-b7eb-917a6b1051ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:53 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Volume 0e5af556-5e5f-4afa-b232-c5f80d1a6867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867', 'volume_size': 1} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:53 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.info" returned: 0 in 0.369s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:53 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.info is being set with open permissions: ugo+rw Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:53 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.info Jul 24 12:58:53 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:53 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.info" returned: 0 in 0.303s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.582s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-169892284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5af556-5e5f-4afa-b232-c5f80d1a6867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:58:53Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Creating volume 0e5af556-5e5f-4afa-b232-c5f80d1a6867 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:53 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:53 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 1073741824 Jul 24 12:58:53 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:54 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e745c745-61b6-4e87-902f-b8479bd2a02e tempest-ProjectMemberTests-2053079969 None] Create snapshot completed successfully Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-c363da29-9f35-4b82-9bae-6d4e71bc7600-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:54 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-c363da29-9f35-4b82-9bae-6d4e71bc7600-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 1073741824" returned: 0 in 0.696s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-c363da29-9f35-4b82-9bae-6d4e71bc7600" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-c363da29-9f35-4b82-9bae-6d4e71bc7600" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Deleting offline snapshot c363da29-9f35-4b82-9bae-6d4e71bc7600 of volume 367ed6b8-1563-4df2-8ea5-ce0b45a6df4d {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] snapshot_file for this snap is: volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e3abed-6f46-4ddb-b992-4a672a8d8819]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:54 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 Jul 24 12:58:54 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:54 devstack sudo[108959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 Jul 24 12:58:54 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:55 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867" returned: 0 in 0.353s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5996de05-3338-4124-b7eb-917a6b1051ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd3b9e0-5bdc-41bb-8c65-c16fdf89ed91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:55 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Volume volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 (0e5af556-5e5f-4afa-b232-c5f80d1a6867): created successfully Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd3b9e0-5bdc-41bb-8c65-c16fdf89ed91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (b8fdfdaf-12a9-4c79-942e-d725f31b3a3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:55 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c0b387dd-5c0c-4bad-8840-62cd3f22aa38 tempest-ProjectReaderTests-866179016 None] Created volume successfully. Jul 24 12:58:55 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600" returned: 0 in 0.490s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e59419-0970-4936-aeb3-d6b2be496a09]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:55 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d Jul 24 12:58:55 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:55 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" returned: 0 in 0.442s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:55 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 Jul 24 12:58:55 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Creating offline snapshot 166a774e-0c9a-4d6c-bab8-323b3110ee91 of volume 0e5af556-5e5f-4afa-b232-c5f80d1a6867 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcbe7e0-0ce3-4d54-8255-ba88d9ce811e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:56 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 Jul 24 12:58:56 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:56 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600" returned: 0 in 0.627s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:56 devstack sudo[109012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600 Jul 24 12:58:56 devstack sudo[109012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:56 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867" returned: 0 in 0.477s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:56 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 1G Jul 24 12:58:56 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:56 devstack sudo[109012]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d.c363da29-9f35-4b82-9bae-6d4e71bc7600" returned: 0 in 0.403s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-c363da29-9f35-4b82-9bae-6d4e71bc7600" released by "_delete_snapshot" :: held 2.115s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" released by "delete_snapshot" :: held 2.171s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:56 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Created reservations ['2dcd032f-71fd-41a6-873f-e3fc4031a364', '0f992597-67d7-446d-9b2c-0f1960cf4183', '1661c24d-aae5-4856-91e9-062082f52075', '372e4513-5efb-409f-a4ef-ac4ca204da31'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Delete snapshot completed successfully. Jul 24 12:58:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-17f71586-8904-4a09-8310-af376c21ff3d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-c363da29-9f35-4b82-9bae-6d4e71bc7600-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:57 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 1G" returned: 0 in 0.554s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:57 devstack sudo[109027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 Jul 24 12:58:57 devstack sudo[109027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:57 devstack sudo[109027]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91" returned: 0 in 0.396s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:57 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 is being set with open permissions: ugo+rw Jul 24 12:58:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:57 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 Jul 24 12:58:57 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:57 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91" returned: 0 in 0.298s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:57 devstack sudo[109035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.info Jul 24 12:58:57 devstack sudo[109035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[3633d1b5-361d-4191-b64b-587d1aee770e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:58 devstack sudo[109035]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.info" returned: 0 in 0.315s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:58 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.info is being set with open permissions: ugo+rw Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:58 devstack sudo[109039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.info Jul 24 12:58:58 devstack sudo[109039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:58 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d Jul 24 12:58:58 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:58 devstack sudo[109039]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.info" returned: 0 in 0.310s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.529s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:58 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" returned: 0 in 0.421s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:58 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d Jul 24 12:58:58 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-28dccd30-bb37-489e-af64-8383340a33d1 tempest-ProjectReaderTests-866179016 None] Create snapshot completed successfully Jul 24 12:58:58 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:58 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d" released by "delete_volume" :: held 0.789s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Created reservations ['a21459d8-792b-4ee9-882b-bf6a7fbf48d7', 'a6f795c5-ec04-4fd5-b7ca-1d505e32719b', 'da1892ff-7182-4870-8ecb-22bec81de269', 'ca32b9b1-0d46-4e52-8d84-1eae8f748e7e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:58 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:58:58 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-166a774e-0c9a-4d6c-bab8-323b3110ee91-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Lock "cinder-166a774e-0c9a-4d6c-bab8-323b3110ee91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-0e5af556-5e5f-4afa-b232-c5f80d1a6867" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-0e5af556-5e5f-4afa-b232-c5f80d1a6867" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-166a774e-0c9a-4d6c-bab8-323b3110ee91" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:58:59 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.327s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-166a774e-0c9a-4d6c-bab8-323b3110ee91" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Deleting offline snapshot 166a774e-0c9a-4d6c-bab8-323b3110ee91 of volume 0e5af556-5e5f-4afa-b232-c5f80d1a6867 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] snapshot_file for this snap is: volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:58:59 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Deleted volume successfully. Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ab86cd-b0f5-4807-97b2-660a77ca5d11]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-be0219d3-6405-4192-b983-5671280cd190 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-367ed6b8-1563-4df2-8ea5-ce0b45a6df4d-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:58:59 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 Jul 24 12:58:59 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (81bd6d84-d76d-4ae6-a4f8-f34e2ea03e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7db1ad7-575f-4217-90e7-3cba075fec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7db1ad7-575f-4217-90e7-3cba075fec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383786597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945ef762-c159-43a2-b5cc-fcf72f06d716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:00Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ebcde3-2212-41a0-b78c-49b049b04dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ebcde3-2212-41a0-b78c-49b049b04dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d4f98b-89d3-4ecc-9be6-1d067e1f6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13d4f98b-89d3-4ecc-9be6-1d067e1f6046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '945ef762-c159-43a2-b5cc-fcf72f06d716', 'volume_name': 'volume-945ef762-c159-43a2-b5cc-fcf72f06d716', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f5b6a1-e27e-45d1-b1d2-11765ad3b0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f5b6a1-e27e-45d1-b1d2-11765ad3b0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7395b482-7c05-416e-9e4b-2689ab269d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:58:59 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Volume 945ef762-c159-43a2-b5cc-fcf72f06d716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-945ef762-c159-43a2-b5cc-fcf72f06d716', 'volume_size': 1} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383786597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=945ef762-c159-43a2-b5cc-fcf72f06d716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:00Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Creating volume 945ef762-c159-43a2-b5cc-fcf72f06d716 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:58:59 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:58:59 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 1073741824 Jul 24 12:58:59 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:58:59 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91" returned: 0 in 0.532s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bb1287-85c9-4dde-904b-a66af50474d1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:58:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:00 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 Jul 24 12:59:00 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:00 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867" returned: 0 in 0.474s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:00 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 Jul 24 12:59:00 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:00 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 1073741824" returned: 0 in 0.640s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:00 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 Jul 24 12:59:00 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:00 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716" returned: 0 in 0.305s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7395b482-7c05-416e-9e4b-2689ab269d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-945ef762-c159-43a2-b5cc-fcf72f06d716', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6974fc93-8344-4e76-8959-1264a6d1910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:00 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91" returned: 0 in 0.469s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:00 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Volume volume-945ef762-c159-43a2-b5cc-fcf72f06d716 (945ef762-c159-43a2-b5cc-fcf72f06d716): created successfully Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6974fc93-8344-4e76-8959-1264a6d1910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:00 devstack sudo[109077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91 Jul 24 12:59:00 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (81bd6d84-d76d-4ae6-a4f8-f34e2ea03e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:00 devstack sudo[109077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:00 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-166b11cf-da55-4518-abf0-ae1eee8ec857 tempest-ProjectMemberTests-2053079969 None] Created volume successfully. Jul 24 12:59:01 devstack sudo[109077]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867.166a774e-0c9a-4d6c-bab8-323b3110ee91" returned: 0 in 0.245s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-166a774e-0c9a-4d6c-bab8-323b3110ee91" released by "_delete_snapshot" :: held 1.844s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-0e5af556-5e5f-4afa-b232-c5f80d1a6867" released by "delete_snapshot" :: held 1.897s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Created reservations ['dfca967d-4a0e-4897-894b-986f34d9f366', '85ea4f61-1d28-4b56-8bef-31db33512f8a', 'efba8c2f-3e14-40d3-b2e5-e7495dddc2a8', '9702ed3d-8eb0-4313-a5b8-e47b5a406666'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:01 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Delete snapshot completed successfully. Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79dac856-1a0d-402a-84ed-6687e734c966 tempest-ProjectReaderTests-866179016 None] Lock "cinder-166a774e-0c9a-4d6c-bab8-323b3110ee91-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-0e5af556-5e5f-4afa-b232-c5f80d1a6867-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Lock "cinder-0e5af556-5e5f-4afa-b232-c5f80d1a6867-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-0e5af556-5e5f-4afa-b232-c5f80d1a6867" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-0e5af556-5e5f-4afa-b232-c5f80d1a6867" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09cba8b-940d-482b-ba64-46f581d3ec8c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:01 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 Jul 24 12:59:01 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:01 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867" returned: 0 in 0.441s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:01 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867 Jul 24 12:59:01 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Creating offline snapshot d21abdd8-28c2-4548-ae41-315a0000e0ac of volume 945ef762-c159-43a2-b5cc-fcf72f06d716 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0b743d-6e3c-4833-9da4-a940cd47066f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:02 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 Jul 24 12:59:02 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:02 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-0e5af556-5e5f-4afa-b232-c5f80d1a6867" returned: 0 in 0.299s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-0e5af556-5e5f-4afa-b232-c5f80d1a6867" released by "delete_volume" :: held 0.799s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Created reservations ['eb259a38-b4f3-4466-93b0-cefb7c0794a5', 'beb67bcf-1a60-454f-8761-92d83865191e', 'ae95b460-4102-4604-be1e-da72a12a853f', 'a0ab9039-e323-406a-bb06-fce794784d4b'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:02 devstack sudo[109090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:02 devstack sudo[109090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:02 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716" returned: 0 in 0.522s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:02 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac 1G Jul 24 12:59:02 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:02 devstack sudo[109090]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.304s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:02 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Deleted volume successfully. Jul 24 12:59:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aa0d09d4-0837-4d27-8cc3-ec0e0c68bf7f tempest-ProjectReaderTests-866179016 None] Lock "cinder-0e5af556-5e5f-4afa-b232-c5f80d1a6867-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:03 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac 1G" returned: 0 in 0.579s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945ef762-c159-43a2-b5cc-fcf72f06d716 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:03 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945ef762-c159-43a2-b5cc-fcf72f06d716 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac Jul 24 12:59:03 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (3484b646-2836-49b2-8169-19dd132ef1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3287c63d-852a-42c4-b95a-5ba73d13e810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3287c63d-852a-42c4-b95a-5ba73d13e810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670126360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40a99d9-b1ac-4e14-916e-1e4d27b36f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:03Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27553d9e-b32e-4428-9410-a52009d3df63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27553d9e-b32e-4428-9410-a52009d3df63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f738d3a-9be2-4838-b7cb-5f311dbb444f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f738d3a-9be2-4838-b7cb-5f311dbb444f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40a99d9-b1ac-4e14-916e-1e4d27b36f8b', 'volume_name': 'volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b3fc17-fdd4-4c9e-a54c-f2782d823a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b3fc17-fdd4-4c9e-a54c-f2782d823a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d23c49e-db8f-4de9-8151-6698c679c6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:03 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Volume b40a99d9-b1ac-4e14-916e-1e4d27b36f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b', 'volume_size': 1} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:03 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-945ef762-c159-43a2-b5cc-fcf72f06d716 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac" returned: 0 in 0.335s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:03 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac is being set with open permissions: ugo+rw Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:03 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac Jul 24 12:59:03 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:03 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac" returned: 0 in 0.278s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:03 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.info Jul 24 12:59:03 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:04 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.info" returned: 0 in 0.271s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:04 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.info is being set with open permissions: ugo+rw Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:04 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.info Jul 24 12:59:04 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:04 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.info" returned: 0 in 0.249s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.066s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1670126360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40a99d9-b1ac-4e14-916e-1e4d27b36f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:03Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Creating volume b40a99d9-b1ac-4e14-916e-1e4d27b36f8b {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:04 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:04 devstack sudo[109123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b 1073741824 Jul 24 12:59:04 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:04 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-adc7c473-a03d-466b-b70f-3d8e04dfa1f8 tempest-ProjectMemberTests-2053079969 None] Create snapshot completed successfully Jul 24 12:59:04 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b 1073741824" returned: 0 in 0.436s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:04 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b Jul 24 12:59:04 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:05 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" returned: 0 in 0.249s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d23c49e-db8f-4de9-8151-6698c679c6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac6bed5-cb61-49a4-89a2-36c3772086e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-d21abdd8-28c2-4548-ae41-315a0000e0ac-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:05 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Volume volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b (b40a99d9-b1ac-4e14-916e-1e4d27b36f8b): created successfully Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac6bed5-cb61-49a4-89a2-36c3772086e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (3484b646-2836-49b2-8169-19dd132ef1aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-d21abdd8-28c2-4548-ae41-315a0000e0ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-945ef762-c159-43a2-b5cc-fcf72f06d716" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:05 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b177e34e-b290-4c30-92f2-ba219a8ddc8f tempest-ProjectReaderTests-866179016 None] Created volume successfully. Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-945ef762-c159-43a2-b5cc-fcf72f06d716" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-d21abdd8-28c2-4548-ae41-315a0000e0ac" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-d21abdd8-28c2-4548-ae41-315a0000e0ac" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Deleting offline snapshot d21abdd8-28c2-4548-ae41-315a0000e0ac of volume 945ef762-c159-43a2-b5cc-fcf72f06d716 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] snapshot_file for this snap is: volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f27816-53c3-4c47-bb16-76c9979cda57]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:05 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac Jul 24 12:59:05 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Creating offline snapshot fec0811b-c8e9-42de-9bbe-e344a810cbec of volume b40a99d9-b1ac-4e14-916e-1e4d27b36f8b {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b42038-69f9-46ec-9e75-85c786835022]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:05 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b Jul 24 12:59:05 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:05 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac" returned: 0 in 0.427s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-945ef762-c159-43a2-b5cc-fcf72f06d716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d380e9b-d4b3-4347-8652-b34385370959]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:05 devstack sudo[109139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 Jul 24 12:59:05 devstack sudo[109139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:05 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" returned: 0 in 0.507s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:06 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec 1G Jul 24 12:59:06 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:06 devstack sudo[109139]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716" returned: 0 in 0.486s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:06 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac Jul 24 12:59:06 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:06 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec 1G" returned: 0 in 0.507s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:06 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec Jul 24 12:59:06 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:06 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac" returned: 0 in 0.440s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:06 devstack sudo[109160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac Jul 24 12:59:06 devstack sudo[109160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:06 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec" returned: 0 in 0.328s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:06 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec is being set with open permissions: ugo+rw Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:06 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec Jul 24 12:59:06 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:06 devstack sudo[109160]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716.d21abdd8-28c2-4548-ae41-315a0000e0ac" returned: 0 in 0.278s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-d21abdd8-28c2-4548-ae41-315a0000e0ac" released by "_delete_snapshot" :: held 1.760s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:06 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-945ef762-c159-43a2-b5cc-fcf72f06d716" released by "delete_snapshot" :: held 1.791s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Created reservations ['35ad6c8e-94a8-45cf-b371-2ed34639cfc2', '2e486037-d092-4f34-b433-0fb0c08a67e4', '5b44dc7b-287a-44c3-b4a0-49d685a30b1e', '597e22be-5acc-4354-aebd-ce187f0f7814'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:07 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Delete snapshot completed successfully. Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9ef3158e-81a8-45f7-96b4-691a1f468505 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-d21abdd8-28c2-4548-ae41-315a0000e0ac-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:07 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec" returned: 0 in 0.261s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:07 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.info Jul 24 12:59:07 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-945ef762-c159-43a2-b5cc-fcf72f06d716-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:07 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-945ef762-c159-43a2-b5cc-fcf72f06d716-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.info" returned: 0 in 0.263s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:07 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.info is being set with open permissions: ugo+rw Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:07 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.info Jul 24 12:59:07 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-945ef762-c159-43a2-b5cc-fcf72f06d716" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-945ef762-c159-43a2-b5cc-fcf72f06d716" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae8d1a8-133d-4354-82af-e84723a4c77f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:07 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 Jul 24 12:59:07 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:07 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.info" returned: 0 in 0.288s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:07 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-123cf1da-7e4d-4ad0-af9a-194b7b783b21 tempest-ProjectReaderTests-866179016 None] Create snapshot completed successfully Jul 24 12:59:07 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716" returned: 0 in 0.383s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:07 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716 Jul 24 12:59:07 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:08 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-945ef762-c159-43a2-b5cc-fcf72f06d716" returned: 0 in 0.267s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-945ef762-c159-43a2-b5cc-fcf72f06d716" released by "delete_volume" :: held 0.720s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Created reservations ['db84ca53-8046-4308-afca-2a36f9e0fa87', '29dabf45-d43f-422a-9f92-e1668bfd76f3', '554a7a33-95c8-4aed-827a-59c3b9ab408b', '35bf9153-dd5d-4599-9de0-6a34ea2e8e5d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:08 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:08 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:08 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.260s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Deleted volume successfully. Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-433a2dd0-0b72-4fe4-829c-e606c8a35293 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-945ef762-c159-43a2-b5cc-fcf72f06d716-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-fec0811b-c8e9-42de-9bbe-e344a810cbec-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Lock "cinder-fec0811b-c8e9-42de-9bbe-e344a810cbec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" acquired by "delete_snapshot" :: waited 0.033s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-fec0811b-c8e9-42de-9bbe-e344a810cbec" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-fec0811b-c8e9-42de-9bbe-e344a810cbec" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Deleting offline snapshot fec0811b-c8e9-42de-9bbe-e344a810cbec of volume b40a99d9-b1ac-4e14-916e-1e4d27b36f8b {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] snapshot_file for this snap is: volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6ae83-c5e9-41d0-8383-312e577a47e9]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:09 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec Jul 24 12:59:09 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (112b2376-e624-4394-9ff2-0c225e1234d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb12d25c-ce24-42c0-95f5-e3ff7db3ee69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:09 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec" returned: 0 in 0.540s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb12d25c-ce24-42c0-95f5-e3ff7db3ee69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323524934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13f194f-e677-4dbe-8be4-c33e4660d242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:09Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9f35d0-d190-4dff-a633-3e4e6deb7a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9f35d0-d190-4dff-a633-3e4e6deb7a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2ca4a1-0276-42fb-863e-7833dea78c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2ca4a1-0276-42fb-863e-7833dea78c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd13f194f-e677-4dbe-8be4-c33e4660d242', 'volume_name': 'volume-d13f194f-e677-4dbe-8be4-c33e4660d242', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993cc43f-e57b-4357-a5a1-e70bd4e8e63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (993cc43f-e57b-4357-a5a1-e70bd4e8e63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0ac089-3d5b-4d75-b2fd-252e7c85093a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:09 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Volume d13f194f-e677-4dbe-8be4-c33e4660d242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d13f194f-e677-4dbe-8be4-c33e4660d242', 'volume_size': 1} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-323524934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13f194f-e677-4dbe-8be4-c33e4660d242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:09Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Creating volume d13f194f-e677-4dbe-8be4-c33e4660d242 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:09 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[36255475-7319-495b-8e2a-c442ea647381]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:09 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 1073741824 Jul 24 12:59:09 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:09 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b Jul 24 12:59:09 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:09 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" returned: 0 in 0.399s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:09 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec Jul 24 12:59:09 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:09 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 1073741824" returned: 0 in 0.507s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:10 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 Jul 24 12:59:10 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:10 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec" returned: 0 in 0.426s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:10 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242" returned: 0 in 0.309s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:10 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec Jul 24 12:59:10 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e0ac089-3d5b-4d75-b2fd-252e7c85093a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d13f194f-e677-4dbe-8be4-c33e4660d242', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c19e3f-f056-4b6c-b553-474537e2ef9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:10 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Volume volume-d13f194f-e677-4dbe-8be4-c33e4660d242 (d13f194f-e677-4dbe-8be4-c33e4660d242): created successfully Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c19e3f-f056-4b6c-b553-474537e2ef9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (112b2376-e624-4394-9ff2-0c225e1234d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1d44ab82-6e81-4bd1-81de-f717da9d10c8 tempest-ProjectMemberTests-2053079969 None] Created volume successfully. Jul 24 12:59:10 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b.fec0811b-c8e9-42de-9bbe-e344a810cbec" returned: 0 in 0.260s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-fec0811b-c8e9-42de-9bbe-e344a810cbec" released by "_delete_snapshot" :: held 1.815s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" released by "delete_snapshot" :: held 1.848s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Created reservations ['cf88e283-485c-428f-8dc4-1e49227adb5d', '298022af-1c6a-411f-b036-f01ce18670b2', 'ff2ec4f9-bd37-4e02-a693-d967fdee2085', 'ffcf644c-3522-4631-b4da-2fc6e330a45b'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Delete snapshot completed successfully. Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-79a21ed1-bf89-4290-b13e-05b7a4ef4a08 tempest-ProjectReaderTests-866179016 None] Lock "cinder-fec0811b-c8e9-42de-9bbe-e344a810cbec-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Lock "cinder-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad973aa-62ad-4064-91b2-05058dbe1e7d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:11 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b Jul 24 12:59:11 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:11 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" returned: 0 in 0.507s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:11 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b Jul 24 12:59:11 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Creating offline snapshot 96c5cdb9-886a-47d1-964b-a46fc92a24a2 of volume d13f194f-e677-4dbe-8be4-c33e4660d242 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1cd7306-917f-444d-9363-4a5e5ba17b4c]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:11 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" returned: 0 in 0.363s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b" released by "delete_volume" :: held 0.946s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:11 devstack sudo[109222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 Jul 24 12:59:11 devstack sudo[109222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:11 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Created reservations ['de66e79d-d5d4-4c8e-a8da-a36b0dab5d02', '3c2aa4f2-98a3-47ed-92ee-196947e1e3b4', 'd6b850bd-a37f-4adf-8318-ff9c92bfbfd0', '9ca71b92-f402-4096-87f5-d0f6e61b5b6e'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:12 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:12 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:12 devstack sudo[109222]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242" returned: 0 in 0.434s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:12 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 1G Jul 24 12:59:12 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:12 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.270s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Deleted volume successfully. Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-26602b6c-60f4-48c7-a0af-bd37a1c5b936 tempest-ProjectReaderTests-866179016 None] Lock "cinder-b40a99d9-b1ac-4e14-916e-1e4d27b36f8b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:12 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 1G" returned: 0 in 0.441s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d13f194f-e677-4dbe-8be4-c33e4660d242 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:12 devstack sudo[109236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d13f194f-e677-4dbe-8be4-c33e4660d242 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 Jul 24 12:59:12 devstack sudo[109236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Flow 'volume_create_manager' (f8a77bab-ba08-4beb-8ec9-7c07c5d56fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52053fc4-d3dd-48ac-8ae1-dca8216a56f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52053fc4-d3dd-48ac-8ae1-dca8216a56f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-697837569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bd9ede-abc9-424a-b997-3de8e9b5bae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ac353317f4bb587cf21f337e85852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:13Z,use_quota=True,user_id='d09ce76ccdf34e50ba28c55356dcf889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242c447a-ce98-4062-aef9-37b03e0aaa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242c447a-ce98-4062-aef9-37b03e0aaa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9201b425-e741-479c-af22-10929e41a4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9201b425-e741-479c-af22-10929e41a4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bd9ede-abc9-424a-b997-3de8e9b5bae5', 'volume_name': 'volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4097750-0def-4ccf-9a71-8cfb8d1646c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4097750-0def-4ccf-9a71-8cfb8d1646c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789023ad-5ffa-4154-948c-98058988328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:12 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Volume 10bd9ede-abc9-424a-b997-3de8e9b5bae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5', 'volume_size': 1} Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:12 devstack sudo[109236]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d13f194f-e677-4dbe-8be4-c33e4660d242 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2" returned: 0 in 0.288s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:12 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 is being set with open permissions: ugo+rw Jul 24 12:59:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:12 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 Jul 24 12:59:12 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:13 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2" returned: 0 in 0.239s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:13 devstack sudo[109244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.info Jul 24 12:59:13 devstack sudo[109244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:13 devstack sudo[109244]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.info" returned: 0 in 0.259s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:13 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.info is being set with open permissions: ugo+rw Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:13 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.info Jul 24 12:59:13 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (fd29624d-21be-4d52-8c6a-72088814b468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798e89f4-572b-4a0b-982f-7a90b86f24c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798e89f4-572b-4a0b-982f-7a90b86f24c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253033235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165b490f-08c3-4ed3-92d6-d7629138e150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:14Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65803109-35e5-48fb-a689-14d5dbdee4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65803109-35e5-48fb-a689-14d5dbdee4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fff07c9-425f-40e5-b316-acfe3ac26825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fff07c9-425f-40e5-b316-acfe3ac26825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165b490f-08c3-4ed3-92d6-d7629138e150', 'volume_name': 'volume-165b490f-08c3-4ed3-92d6-d7629138e150', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1ae23a-9a9e-485f-8035-cf62ff775dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c1ae23a-9a9e-485f-8035-cf62ff775dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7472abe-6229-4956-ba3e-2332ae7e6b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:13 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Volume 165b490f-08c3-4ed3-92d6-d7629138e150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165b490f-08c3-4ed3-92d6-d7629138e150', 'volume_size': 1} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:13 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.info" returned: 0 in 0.243s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-697837569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bd9ede-abc9-424a-b997-3de8e9b5bae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ac353317f4bb587cf21f337e85852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:13Z,use_quota=True,user_id='d09ce76ccdf34e50ba28c55356dcf889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Creating volume 10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:13 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:13 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:13 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 1073741824 Jul 24 12:59:13 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:13 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7c2f9934-c541-4ef1-ae9b-a601d84bc08c tempest-ProjectMemberTests-2053079969 None] Create snapshot completed successfully Jul 24 12:59:14 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 1073741824" returned: 0 in 0.397s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:14 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 Jul 24 12:59:14 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:14 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5" returned: 0 in 0.241s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.746s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253033235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165b490f-08c3-4ed3-92d6-d7629138e150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:14Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Creating volume 165b490f-08c3-4ed3-92d6-d7629138e150 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:14 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (789023ad-5ffa-4154-948c-98058988328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:14 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 1073741824 Jul 24 12:59:14 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbc1f26-fa5b-4622-9e4e-f6b5e525edd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:14 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Volume volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 (10bd9ede-abc9-424a-b997-3de8e9b5bae5): created successfully Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cbc1f26-fa5b-4622-9e4e-f6b5e525edd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Flow 'volume_create_manager' (f8a77bab-ba08-4beb-8ec9-7c07c5d56fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:14 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-3cf5c0ae-9b9d-4f7b-b074-8fe73eaba54d tempest-SnapshotDependencyTests-2088130180 None] Created volume successfully. Jul 24 12:59:14 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 1073741824" returned: 0 in 0.440s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-96c5cdb9-886a-47d1-964b-a46fc92a24a2-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-96c5cdb9-886a-47d1-964b-a46fc92a24a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-d13f194f-e677-4dbe-8be4-c33e4660d242" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-d13f194f-e677-4dbe-8be4-c33e4660d242" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:14 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 Jul 24 12:59:14 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-96c5cdb9-886a-47d1-964b-a46fc92a24a2" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-96c5cdb9-886a-47d1-964b-a46fc92a24a2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Deleting offline snapshot 96c5cdb9-886a-47d1-964b-a46fc92a24a2 of volume d13f194f-e677-4dbe-8be4-c33e4660d242 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:14 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] snapshot_file for this snap is: volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca46e332-03d9-4983-87a3-2e797ffc21f4]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:15 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 Jul 24 12:59:15 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:15 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150" returned: 0 in 0.276s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.085s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7472abe-6229-4956-ba3e-2332ae7e6b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165b490f-08c3-4ed3-92d6-d7629138e150', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c789df-bcde-4827-9c13-23739a7b3bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Creating offline snapshot 8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 of volume 10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:15 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Volume volume-165b490f-08c3-4ed3-92d6-d7629138e150 (165b490f-08c3-4ed3-92d6-d7629138e150): created successfully Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c789df-bcde-4827-9c13-23739a7b3bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (fd29624d-21be-4d52-8c6a-72088814b468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bfc3cd-7da2-4fce-901e-b93eef44bf19]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:15 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-be189a96-c167-40d7-b2b2-3d1ea0beb987 tempest-ProjectReaderTests-866179016 None] Created volume successfully. Jul 24 12:59:15 devstack sudo[109269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 Jul 24 12:59:15 devstack sudo[109269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:15 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2" returned: 0 in 0.389s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d13f194f-e677-4dbe-8be4-c33e4660d242(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbce176-06f9-475c-8fed-22e7837634cf]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:15 devstack sudo[109274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 Jul 24 12:59:15 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:15 devstack sudo[109269]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5" returned: 0 in 0.408s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:15 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 1G Jul 24 12:59:15 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:15 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242" returned: 0 in 0.407s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:15 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:15 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 Jul 24 12:59:15 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:16 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 1G" returned: 0 in 0.428s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:16 devstack sudo[109291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 Jul 24 12:59:16 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:16 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2" returned: 0 in 0.357s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:16 devstack sudo[109294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2 Jul 24 12:59:16 devstack sudo[109294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:16 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517" returned: 0 in 0.286s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:16 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 is being set with open permissions: ugo+rw Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:16 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 Jul 24 12:59:16 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:16 devstack sudo[109294]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242.96c5cdb9-886a-47d1-964b-a46fc92a24a2" returned: 0 in 0.255s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-96c5cdb9-886a-47d1-964b-a46fc92a24a2" released by "_delete_snapshot" :: held 1.510s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-d13f194f-e677-4dbe-8be4-c33e4660d242" released by "delete_snapshot" :: held 1.544s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Created reservations ['e03c450b-889e-4bc0-a4ab-eba1b1c58ca5', '482f0266-48fd-43d8-8c8b-f298551a5eeb', '8d16bbdd-9797-4cfd-a5bb-1d6d15dd939d', '256fa26e-9c2b-48f4-bb6f-aeb3ca43813c'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:16 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Delete snapshot completed successfully. Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-aeba66ed-25ed-41ad-969b-72551d5b53a3 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-96c5cdb9-886a-47d1-964b-a46fc92a24a2-delete_snapshot" released by "delete_snapshot" :: held 1.695s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:16 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517" returned: 0 in 0.262s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:16 devstack sudo[109303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.info Jul 24 12:59:16 devstack sudo[109303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:16 devstack sudo[109303]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.info" returned: 0 in 0.246s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:16 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.info is being set with open permissions: ugo+rw Jul 24 12:59:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:16 devstack sudo[109306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.info Jul 24 12:59:16 devstack sudo[109306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-d13f194f-e677-4dbe-8be4-c33e4660d242-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Lock "cinder-d13f194f-e677-4dbe-8be4-c33e4660d242-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-d13f194f-e677-4dbe-8be4-c33e4660d242" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-d13f194f-e677-4dbe-8be4-c33e4660d242" acquired by "delete_volume" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5ee873-90e7-443e-8118-1f9c53c46073]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:17 devstack sudo[109306]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.info" returned: 0 in 0.258s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.374s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Creating offline snapshot 7cae695f-effc-4d0c-96a1-3de98df447ea of volume 165b490f-08c3-4ed3-92d6-d7629138e150 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:17 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0332e2c0-5adb-42f6-b1c3-2b2257df726e tempest-SnapshotDependencyTests-2088130180 None] Create snapshot completed successfully Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73c6924-85b2-43eb-b743-8ef23104cf5d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:17 devstack sudo[109309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 Jul 24 12:59:17 devstack sudo[109309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:17 devstack sudo[109310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 Jul 24 12:59:17 devstack sudo[109310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:17 devstack sudo[109309]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242" returned: 0 in 0.373s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:17 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242 Jul 24 12:59:17 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:17 devstack sudo[109310]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150" returned: 0 in 0.371s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:17 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea 1G Jul 24 12:59:17 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:17 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d13f194f-e677-4dbe-8be4-c33e4660d242" returned: 0 in 0.253s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-d13f194f-e677-4dbe-8be4-c33e4660d242" released by "delete_volume" :: held 0.694s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Created reservations ['91c40c68-2d55-4d97-b585-6468f2890b05', 'c6381d56-cf65-4f56-a53d-06786a667e56', 'bb8d9f95-1774-48b1-bf4d-09a790750efd', '74de5600-921f-4fb8-b573-a482cfe4c170'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:17 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:17 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:18 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea 1G" returned: 0 in 0.434s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165b490f-08c3-4ed3-92d6-d7629138e150 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:18 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165b490f-08c3-4ed3-92d6-d7629138e150 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea Jul 24 12:59:18 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:18 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.251s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Deleted volume successfully. Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-4b09b9a1-2796-4cb7-b747-6b1288102a2b tempest-ProjectMemberTests-2053079969 None] Lock "cinder-d13f194f-e677-4dbe-8be4-c33e4660d242-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:18 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-165b490f-08c3-4ed3-92d6-d7629138e150 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea" returned: 0 in 0.326s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:18 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea is being set with open permissions: ugo+rw Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:18 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea Jul 24 12:59:18 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:18 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea" returned: 0 in 0.266s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:18 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.info Jul 24 12:59:18 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (b2f7245f-769c-438f-8939-d97a1b948b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef24507-0f2d-4181-8bfc-58bda85abf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef24507-0f2d-4181-8bfc-58bda85abf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138180316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146d6863-7194-48d0-8233-7799dcef1c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:19Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18df3029-dfab-4fcb-a730-8fa1e2cb70ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18df3029-dfab-4fcb-a730-8fa1e2cb70ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac41372-d6d5-4f20-986f-c31aee8f8eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac41372-d6d5-4f20-986f-c31aee8f8eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146d6863-7194-48d0-8233-7799dcef1c67', 'volume_name': 'volume-146d6863-7194-48d0-8233-7799dcef1c67', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a42821-e2b5-4f8d-84a1-a9491e84351c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a42821-e2b5-4f8d-84a1-a9491e84351c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4390dcbe-8c03-4042-aad5-7baaf69bf51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Volume 146d6863-7194-48d0-8233-7799dcef1c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146d6863-7194-48d0-8233-7799dcef1c67', 'volume_size': 1} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Flow 'volume_create_manager' (50ac52b4-917d-4f4b-8b77-b4bd870b1595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d162a3-624a-474f-a75e-8023efff06a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d162a3-624a-474f-a75e-8023efff06a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c79091-4b0f-4b07-b9a5-37cb48355885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ac353317f4bb587cf21f337e85852',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:19Z,use_quota=True,user_id='d09ce76ccdf34e50ba28c55356dcf889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3edfa1-7b2e-4a22-9eab-2f1f5ef7899e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b3edfa1-7b2e-4a22-9eab-2f1f5ef7899e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f3db13-a607-4453-83c8-0cf80764e441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f3db13-a607-4453-83c8-0cf80764e441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4c79091-4b0f-4b07-b9a5-37cb48355885', 'volume_name': 'volume-c4c79091-4b0f-4b07-b9a5-37cb48355885', 'volume_size': 1, 'snapshot_id': '8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2deb21-a100-4b34-83a0-55803f4c39ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2deb21-a100-4b34-83a0-55803f4c39ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2661f5-ea1d-4544-b8f5-483f971b4a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:18 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Volume c4c79091-4b0f-4b07-b9a5-37cb48355885: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4c79091-4b0f-4b07-b9a5-37cb48355885', 'volume_size': 1, 'snapshot_id': '8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517'} Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.info" returned: 0 in 0.330s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:18 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.info is being set with open permissions: ugo+rw Jul 24 12:59:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:19 devstack sudo[109342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.info Jul 24 12:59:19 devstack sudo[109342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:19 devstack sudo[109342]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.info" returned: 0 in 0.240s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.063s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138180316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146d6863-7194-48d0-8233-7799dcef1c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:19Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Creating volume 146d6863-7194-48d0-8233-7799dcef1c67 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:19 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:19 devstack sudo[109345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 1073741824 Jul 24 12:59:19 devstack sudo[109345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c5d5e665-b99e-4e5b-a474-1a38684cb789 tempest-ProjectReaderTests-866179016 None] Create snapshot completed successfully Jul 24 12:59:19 devstack sudo[109345]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 1073741824" returned: 0 in 0.405s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:19 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 Jul 24 12:59:19 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:19 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67" returned: 0 in 0.242s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.932s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "cinder-quobyte-8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517-c4c79091-4b0f-4b07-b9a5-37cb48355885" by "_create_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4390dcbe-8c03-4042-aad5-7baaf69bf51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146d6863-7194-48d0-8233-7799dcef1c67', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b2882a-51e5-48ff-a61a-2771b82bf88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517-c4c79091-4b0f-4b07-b9a5-37cb48355885" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Creating volume c4c79091-4b0f-4b07-b9a5-37cb48355885 from snapshot 8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 {{(pid=88540) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "cinder-quobyte-c4c79091-4b0f-4b07-b9a5-37cb48355885" by "_copy_volume_from_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Volume volume-146d6863-7194-48d0-8233-7799dcef1c67 (146d6863-7194-48d0-8233-7799dcef1c67): created successfully Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b2882a-51e5-48ff-a61a-2771b82bf88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (b2f7245f-769c-438f-8939-d97a1b948b1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-7cae695f-effc-4d0c-96a1-3de98df447ea-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:20 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4e0dfea4-0d7e-489e-a182-547d9b3d7e77 tempest-ProjectMemberTests-2053079969 None] Created volume successfully. Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-c4c79091-4b0f-4b07-b9a5-37cb48355885" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] snapshot: 8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517, volume: c4c79091-4b0f-4b07-b9a5-37cb48355885, {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Lock "cinder-7cae695f-effc-4d0c-96a1-3de98df447ea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-165b490f-08c3-4ed3-92d6-d7629138e150" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-165b490f-08c3-4ed3-92d6-d7629138e150" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-7cae695f-effc-4d0c-96a1-3de98df447ea" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d264be9f-88f1-4507-a400-ff0c2b2d2ca5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-7cae695f-effc-4d0c-96a1-3de98df447ea" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Deleting offline snapshot 7cae695f-effc-4d0c-96a1-3de98df447ea of volume 165b490f-08c3-4ed3-92d6-d7629138e150 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] snapshot_file for this snap is: volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33e10b4-c593-41ab-a1a5-695a45354675]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:20 devstack sudo[109355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 Jul 24 12:59:20 devstack sudo[109355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:20 devstack sudo[109356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea Jul 24 12:59:20 devstack sudo[109356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:20 devstack sudo[109355]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517" returned: 0 in 0.365s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Creating direct copy from snapshot {{(pid=88540) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[01875687-b1ea-4fa5-9712-32163d1f75e5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:20 devstack sudo[109356]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea" returned: 0 in 0.372s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-165b490f-08c3-4ed3-92d6-d7629138e150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcf070d-bdad-48ea-bf1d-84ba86f516d4]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:20 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 Jul 24 12:59:20 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:20 devstack sudo[109366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 Jul 24 12:59:20 devstack sudo[109366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:20 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5" returned: 0 in 0.404s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG cinder.utils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Path /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 not found in is_blk_device check {{(pid=88540) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:20 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 Jul 24 12:59:20 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:20 devstack sudo[109366]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150" returned: 0 in 0.416s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:20 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea Jul 24 12:59:20 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:21 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea" returned: 0 in 0.340s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:21 devstack sudo[109386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea Jul 24 12:59:21 devstack sudo[109386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:21 devstack sudo[109386]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:21 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150.7cae695f-effc-4d0c-96a1-3de98df447ea" returned: 0 in 0.409s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-7cae695f-effc-4d0c-96a1-3de98df447ea" released by "_delete_snapshot" :: held 1.663s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:21 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-165b490f-08c3-4ed3-92d6-d7629138e150" released by "delete_snapshot" :: held 1.698s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:21 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Created reservations ['19e0a4f2-fe88-45f8-96f0-80442f6891ff', '949aadd2-017f-4f8e-a9ad-676ea5b1e65e', 'e6d36a18-05e4-4bba-88f2-48100b768de3', '44a9f0ba-5ec5-4660-bb0f-b1a854fd40ab'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:22 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Delete snapshot completed successfully. Jul 24 12:59:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4cf321c-a3d5-460a-954e-2a0296fa505c tempest-ProjectReaderTests-866179016 None] Lock "cinder-7cae695f-effc-4d0c-96a1-3de98df447ea-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-165b490f-08c3-4ed3-92d6-d7629138e150-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Lock "cinder-165b490f-08c3-4ed3-92d6-d7629138e150-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-165b490f-08c3-4ed3-92d6-d7629138e150" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:22 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-165b490f-08c3-4ed3-92d6-d7629138e150" acquired by "delete_volume" :: waited 0.031s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:22 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bb3e69-73bb-4a6c-b3d7-0ca688b81140]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:22 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:22 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 Jul 24 12:59:22 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:23 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150" returned: 0 in 0.611s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:23 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150 Jul 24 12:59:23 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:23 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-165b490f-08c3-4ed3-92d6-d7629138e150" returned: 0 in 0.442s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-165b490f-08c3-4ed3-92d6-d7629138e150" released by "delete_volume" :: held 1.189s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Created reservations ['a6be7526-5e19-470e-aaec-b14e7ddb8d2e', 'e92be7be-9dbd-4d9d-893d-a32604feb5cf', 'c27bedd2-75eb-4c4c-9f5a-436fb48e7ef9', '6c7dba0c-35fb-4a8a-8b8c-c993cc82de3d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:23 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:24 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:24 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:24 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:24 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.360s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:24 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:24 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Deleted volume successfully. Jul 24 12:59:24 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-0f3de8d7-2d24-45d7-92b8-3509e6ed4cb3 tempest-ProjectReaderTests-866179016 None] Lock "cinder-165b490f-08c3-4ed3-92d6-d7629138e150-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:25 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885" returned: 0 in 4.735s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bc24ec-ae5e-4a5c-ad18-12b77a402959]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (236c8b63-9406-4049-a01f-433a6c9acc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e4deca-98cf-4169-bcf1-d7f3918633d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e4deca-98cf-4169-bcf1-d7f3918633d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999310142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36a9d04-05e9-49b1-ba50-585a04eb613d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:26Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6469c69-c1fc-4a52-93da-d17b2b334cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6469c69-c1fc-4a52-93da-d17b2b334cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2bdd3c-d8ba-4338-bbfb-a2b004843fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b2bdd3c-d8ba-4338-bbfb-a2b004843fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd36a9d04-05e9-49b1-ba50-585a04eb613d', 'volume_name': 'volume-d36a9d04-05e9-49b1-ba50-585a04eb613d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ae9a8f-9519-48c7-adce-5524d3ab3efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ae9a8f-9519-48c7-adce-5524d3ab3efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a53d01d-41fd-40e1-b7bb-b8cbc970ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:25 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Volume d36a9d04-05e9-49b1-ba50-585a04eb613d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d36a9d04-05e9-49b1-ba50-585a04eb613d', 'volume_size': 1} Jul 24 12:59:25 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:25 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 Jul 24 12:59:25 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:26 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5" returned: 0 in 0.516s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG cinder.image.image_utils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Image conversion details: src /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5, size 1024.00 MB, duration 4.74 sec, destination /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 {{(pid=88540) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 12:59:26 devstack cinder-volume[88540]: INFO cinder.image.image_utils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Converted 1024.00 MB image at 216.17 MB/s Jul 24 12:59:26 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 is being set with open permissions: ugo+rw Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:26 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 Jul 24 12:59:26 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:26 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885" returned: 0 in 0.239s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-c4c79091-4b0f-4b07-b9a5-37cb48355885" released by "_copy_volume_from_snapshot" :: held 6.367s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517-c4c79091-4b0f-4b07-b9a5-37cb48355885" released by "_create_volume_from_snapshot" :: held 6.433s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.467s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.469s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Creating offline snapshot c932bce4-8b28-4fa0-89c2-75ef7245d3e8 of volume 146d6863-7194-48d0-8233-7799dcef1c67 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f2661f5-ea1d-4544-b8f5-483f971b4a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c79091-4b0f-4b07-b9a5-37cb48355885', 'volume_size': 1, 'snapshot_id': '8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517'}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d51ea8-f9de-4c06-8047-98d23a5570c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c924a26f-c941-4a74-9073-a785a4884b99]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:26 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Volume volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 (c4c79091-4b0f-4b07-b9a5-37cb48355885): created successfully Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8d51ea8-f9de-4c06-8047-98d23a5570c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Flow 'volume_create_manager' (50ac52b4-917d-4f4b-8b77-b4bd870b1595) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:26 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9e41524b-fde8-48ad-ac8f-9b6cfd9e6cb7 tempest-SnapshotDependencyTests-2088130180 None] Created volume successfully. Jul 24 12:59:26 devstack sudo[109416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 Jul 24 12:59:26 devstack sudo[109416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:26 devstack sudo[109416]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67" returned: 0 in 0.347s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:26 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:26 devstack sudo[109421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 1G Jul 24 12:59:26 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:27 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 1G" returned: 0 in 0.361s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146d6863-7194-48d0-8233-7799dcef1c67 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:27 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146d6863-7194-48d0-8233-7799dcef1c67 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 Jul 24 12:59:27 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:27 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-146d6863-7194-48d0-8233-7799dcef1c67 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8" returned: 0 in 0.275s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:27 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 is being set with open permissions: ugo+rw Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:27 devstack sudo[109432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 Jul 24 12:59:27 devstack sudo[109432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "cinder-8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "cinder-quobyte-10bd9ede-abc9-424a-b997-3de8e9b5bae5" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-10bd9ede-abc9-424a-b997-3de8e9b5bae5" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "cinder-quobyte-8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Deleting offline snapshot 8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 of volume 10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] snapshot_file for this snap is: volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8" returned: 0 in 0.299s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6f6c58-9633-49dc-8eb4-403a2e9104b6]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:27 devstack sudo[109432]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:27 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:27 devstack sudo[109438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.info Jul 24 12:59:27 devstack sudo[109438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:27 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 Jul 24 12:59:27 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:28 devstack sudo[109438]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.info" returned: 0 in 0.279s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:28 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.info is being set with open permissions: ugo+rw Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:28 devstack sudo[109443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.info Jul 24 12:59:28 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:28 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517" returned: 0 in 0.402s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f673fd6f-a4c6-4541-838c-e6be06e121ec]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:28 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 Jul 24 12:59:28 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:28 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.info" returned: 0 in 0.251s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.630s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999310142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d36a9d04-05e9-49b1-ba50-585a04eb613d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b387de20cd4b178b57e47aae1a4bf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:26Z,use_quota=True,user_id='2bd46f9021b446d597e295aeb0253332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Creating volume d36a9d04-05e9-49b1-ba50-585a04eb613d {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:28 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:28 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d 1073741824 Jul 24 12:59:28 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:28 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-690e4552-dde9-47bd-b2a7-b225f0ea9f08 tempest-ProjectMemberTests-2053079969 None] Create snapshot completed successfully Jul 24 12:59:28 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5" returned: 0 in 0.372s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:28 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 Jul 24 12:59:28 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:28 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d 1073741824" returned: 0 in 0.430s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:28 devstack sudo[109463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d Jul 24 12:59:28 devstack sudo[109463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:28 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517" returned: 0 in 0.364s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:28 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:28 devstack sudo[109465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517 Jul 24 12:59:28 devstack sudo[109465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:29 devstack sudo[109463]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d" returned: 0 in 0.261s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a53d01d-41fd-40e1-b7bb-b8cbc970ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d36a9d04-05e9-49b1-ba50-585a04eb613d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8802b86-3a0a-42e7-b49b-cae3cb251d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:29 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Volume volume-d36a9d04-05e9-49b1-ba50-585a04eb613d (d36a9d04-05e9-49b1-ba50-585a04eb613d): created successfully Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8802b86-3a0a-42e7-b49b-cae3cb251d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Flow 'volume_create_manager' (236c8b63-9406-4049-a01f-433a6c9acc3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5879cfd3-712a-4fef-beec-3c5f1fc5dfa2 tempest-ProjectReaderTests-866179016 None] Created volume successfully. Jul 24 12:59:29 devstack sudo[109465]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5.8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517" returned: 0 in 0.243s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517" released by "_delete_snapshot" :: held 1.482s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-10bd9ede-abc9-424a-b997-3de8e9b5bae5" released by "delete_snapshot" :: held 1.521s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Created reservations ['05537ef4-7519-4abc-8812-88fa73c9f942', 'a1cce9ac-4e27-43fc-bde4-af1a34aec887', '8c9733f9-98cc-418c-81df-7c89a44c7b89', 'e8ffa5b2-a574-457b-b522-002eba3337d9'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:29 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Delete snapshot completed successfully. Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-6c9de9ee-c5e7-4d40-a3ab-00af614d4f05 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-8f3b8b8e-32e4-4fc6-bcf5-ef78823bb517-delete_snapshot" released by "delete_snapshot" :: held 1.645s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-c932bce4-8b28-4fa0-89c2-75ef7245d3e8-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Lock "cinder-c932bce4-8b28-4fa0-89c2-75ef7245d3e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-146d6863-7194-48d0-8233-7799dcef1c67" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-146d6863-7194-48d0-8233-7799dcef1c67" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-c932bce4-8b28-4fa0-89c2-75ef7245d3e8" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-c932bce4-8b28-4fa0-89c2-75ef7245d3e8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Deleting offline snapshot c932bce4-8b28-4fa0-89c2-75ef7245d3e8 of volume 146d6863-7194-48d0-8233-7799dcef1c67 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] snapshot_file for this snap is: volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b8ecd0-d2d3-443f-b778-57c19d59826e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:29 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 Jul 24 12:59:29 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "cinder-10bd9ede-abc9-424a-b997-3de8e9b5bae5-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-10bd9ede-abc9-424a-b997-3de8e9b5bae5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "cinder-quobyte-10bd9ede-abc9-424a-b997-3de8e9b5bae5" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-10bd9ede-abc9-424a-b997-3de8e9b5bae5" acquired by "delete_volume" :: waited 0.019s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:29 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8" returned: 0 in 0.430s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-146d6863-7194-48d0-8233-7799dcef1c67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[96449751-00eb-46e1-a512-5404bcb46515]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b777288-17cc-460e-b43d-f741751efda7]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:29 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:30 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 Jul 24 12:59:30 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:30 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 Jul 24 12:59:30 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Creating offline snapshot 821c2fc1-bd43-4f0b-926b-7a2644e30875 of volume d36a9d04-05e9-49b1-ba50-585a04eb613d {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f50f9b0-2930-4363-ad2a-28df83e83ddb]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:30 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d Jul 24 12:59:30 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:30 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5" returned: 0 in 0.394s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:30 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67" returned: 0 in 0.400s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:30 devstack sudo[109488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5 Jul 24 12:59:30 devstack sudo[109488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:30 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 Jul 24 12:59:30 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:30 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d" returned: 0 in 0.401s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:30 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 1G Jul 24 12:59:30 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:30 devstack sudo[109488]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-10bd9ede-abc9-424a-b997-3de8e9b5bae5" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-10bd9ede-abc9-424a-b997-3de8e9b5bae5" released by "delete_volume" :: held 0.746s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Created reservations ['5e158cc8-c7f9-4267-b054-1a45e3abab00', 'd5af8827-cc5f-416d-9838-6a7e25e9f0d1', '519beaa4-f363-4021-9080-c3cac6de3ff2', '3b87350f-18de-4cad-9b6b-d3a7125326d7'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:30 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8" returned: 0 in 0.375s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:30 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8 Jul 24 12:59:30 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:30 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:30 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:30 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "cinder-c4c79091-4b0f-4b07-b9a5-37cb48355885-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-c4c79091-4b0f-4b07-b9a5-37cb48355885-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:31 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:31 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 1G" returned: 0 in 0.488s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36a9d04-05e9-49b1-ba50-585a04eb613d -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67.c932bce4-8b28-4fa0-89c2-75ef7245d3e8" returned: 0 in 0.302s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:31 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36a9d04-05e9-49b1-ba50-585a04eb613d -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 Jul 24 12:59:31 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:31 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-c932bce4-8b28-4fa0-89c2-75ef7245d3e8" released by "_delete_snapshot" :: held 1.622s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.314s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-146d6863-7194-48d0-8233-7799dcef1c67" released by "delete_snapshot" :: held 1.652s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:31 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Deleted volume successfully. Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "cinder-quobyte-c4c79091-4b0f-4b07-b9a5-37cb48355885" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-9652655f-8026-4ad6-be34-ee8d30ea3372 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-10bd9ede-abc9-424a-b997-3de8e9b5bae5-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-c4c79091-4b0f-4b07-b9a5-37cb48355885" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2b034e-146c-404a-a6cd-8ba0e1bbf2bb]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Created reservations ['6296f125-6d1b-4f42-96c3-ebade0182bff', '74d920f2-1394-4a87-8e21-0d64a95371d5', '3235fc36-9a72-4521-aae5-ce07b7f95bfd', '9075a8af-9e07-4636-9960-05dc63fb51c4'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:31 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Delete snapshot completed successfully. Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-7d9a4a9e-e18c-494b-9959-f69075a1d6ea tempest-ProjectMemberTests-2053079969 None] Lock "cinder-c932bce4-8b28-4fa0-89c2-75ef7245d3e8-delete_snapshot" released by "delete_snapshot" :: held 1.842s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:31 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 Jul 24 12:59:31 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:31 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d36a9d04-05e9-49b1-ba50-585a04eb613d -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875" returned: 0 in 0.318s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:31 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 is being set with open permissions: ugo+rw Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:31 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 Jul 24 12:59:31 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:31 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-146d6863-7194-48d0-8233-7799dcef1c67-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885" returned: 0 in 0.413s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:31 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875" returned: 0 in 0.274s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-146d6863-7194-48d0-8233-7799dcef1c67-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:31 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885 Jul 24 12:59:31 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:31 devstack sudo[109525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.info Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-146d6863-7194-48d0-8233-7799dcef1c67" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:31 devstack sudo[109525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-146d6863-7194-48d0-8233-7799dcef1c67" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1739a4-39dd-461d-8225-06a0829800d1]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:31 devstack sudo[109529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 Jul 24 12:59:31 devstack sudo[109529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:31 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-c4c79091-4b0f-4b07-b9a5-37cb48355885" returned: 0 in 0.287s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-quobyte-c4c79091-4b0f-4b07-b9a5-37cb48355885" released by "delete_volume" :: held 0.758s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:31 devstack sudo[109525]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.info" returned: 0 in 0.273s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:31 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.info is being set with open permissions: ugo+rw Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:31 devstack sudo[109533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.info Jul 24 12:59:31 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:31 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Created reservations ['59aac72c-68e5-4a9d-88ec-49a86a55d20d', '2d5bcbd1-fdb9-4810-9628-11f935e381da', '5d3c861e-3618-42f4-b935-afed27310a42', 'e31c6b79-1e12-4d13-90bd-c52adff2d78b'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:32 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:32 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:32 devstack sudo[109529]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67" returned: 0 in 0.395s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:32 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67 Jul 24 12:59:32 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:32 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.info" returned: 0 in 0.298s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-9bd6ea64-34f2-4912-a06e-c9663c260551 tempest-ProjectReaderTests-866179016 None] Create snapshot completed successfully Jul 24 12:59:32 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.303s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Deleted volume successfully. Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-101b61f1-f30f-47f9-b1e0-fa826496a964 tempest-SnapshotDependencyTests-2088130180 None] Lock "cinder-c4c79091-4b0f-4b07-b9a5-37cb48355885-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:32 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-146d6863-7194-48d0-8233-7799dcef1c67" returned: 0 in 0.303s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-146d6863-7194-48d0-8233-7799dcef1c67" released by "delete_volume" :: held 0.758s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Created reservations ['fb8693eb-17f9-4a7a-b58a-57b7ccb86e78', 'cdf69251-2afa-4382-909c-d3c22288bdc4', '8557e92a-1a17-4a67-a9ba-971d3e7585c6', 'f949fec5-01d1-4b0a-9833-b2cc39adf48d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:32 devstack sudo[109545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:32 devstack sudo[109545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:32 devstack sudo[109545]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.249s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:32 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Deleted volume successfully. Jul 24 12:59:32 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-f46d03d2-7d86-4187-a99b-10b6036e3877 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-146d6863-7194-48d0-8233-7799dcef1c67-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (e2b7139b-ec68-4f3a-a039-b570746257a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61fd9c1-b8fd-414f-a32f-6acea69aff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-821c2fc1-bd43-4f0b-926b-7a2644e30875-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61fd9c1-b8fd-414f-a32f-6acea69aff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068907618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f56de0-19b3-4aa6-b2f1-baf890fc961a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:33Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2e104c-3024-46df-8bb3-919ba07cb0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2e104c-3024-46df-8bb3-919ba07cb0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f65e9b4-efef-4b70-8ddf-92209762f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f65e9b4-efef-4b70-8ddf-92209762f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f56de0-19b3-4aa6-b2f1-baf890fc961a', 'volume_name': 'volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ef425f-41e1-43df-a6f3-3b056ea41c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5ef425f-41e1-43df-a6f3-3b056ea41c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e048e1-3e1c-4f91-b62c-cfedf3d9df16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:33 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Volume 02f56de0-19b3-4aa6-b2f1-baf890fc961a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a', 'volume_size': 1} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1068907618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f56de0-19b3-4aa6-b2f1-baf890fc961a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:33Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Creating volume 02f56de0-19b3-4aa6-b2f1-baf890fc961a {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:33 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Lock "cinder-821c2fc1-bd43-4f0b-926b-7a2644e30875-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-d36a9d04-05e9-49b1-ba50-585a04eb613d" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:33 devstack sudo[109548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a 1073741824 Jul 24 12:59:33 devstack sudo[109548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-d36a9d04-05e9-49b1-ba50-585a04eb613d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-821c2fc1-bd43-4f0b-926b-7a2644e30875" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-821c2fc1-bd43-4f0b-926b-7a2644e30875" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Deleting offline snapshot 821c2fc1-bd43-4f0b-926b-7a2644e30875 of volume d36a9d04-05e9-49b1-ba50-585a04eb613d {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] snapshot_file for this snap is: volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6d7422-e13f-4068-87f9-9e8b45858196]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:33 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 Jul 24 12:59:33 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:33 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875" returned: 0 in 0.416s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d36a9d04-05e9-49b1-ba50-585a04eb613d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e78ab9-e91e-473c-9cd1-a4f0bd75f6ec]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:33 devstack sudo[109548]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a 1073741824" returned: 0 in 0.555s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:33 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:34 devstack sudo[109561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a Jul 24 12:59:34 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:34 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d Jul 24 12:59:34 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:34 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a" returned: 0 in 0.269s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9e048e1-3e1c-4f91-b62c-cfedf3d9df16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2d38f1-b76b-4c87-95b6-d60ee690550e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:34 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Volume volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a (02f56de0-19b3-4aa6-b2f1-baf890fc961a): created successfully Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2d38f1-b76b-4c87-95b6-d60ee690550e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:34 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (e2b7139b-ec68-4f3a-a039-b570746257a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d" returned: 0 in 0.376s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:34 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-11fbf277-7a8d-46b3-9853-0982d616520b tempest-ProjectMemberTests-2053079969 None] Created volume successfully. Jul 24 12:59:34 devstack sudo[109568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 Jul 24 12:59:34 devstack sudo[109568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:34 devstack sudo[109568]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875" returned: 0 in 0.344s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:34 devstack sudo[109574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875 Jul 24 12:59:34 devstack sudo[109574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:34 devstack sudo[109574]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d.821c2fc1-bd43-4f0b-926b-7a2644e30875" returned: 0 in 0.264s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-821c2fc1-bd43-4f0b-926b-7a2644e30875" released by "_delete_snapshot" :: held 1.506s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:34 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-d36a9d04-05e9-49b1-ba50-585a04eb613d" released by "delete_snapshot" :: held 1.531s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Created reservations ['a03a88e0-a284-41a3-b177-3cd67f255611', 'bd71e492-4aa5-470b-93c2-996d3aab0a6b', 'a9952b2d-55cf-4555-885c-62a184dd46f7', '38e52718-779b-4ba8-838d-fdb65949b114'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:35 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Delete snapshot completed successfully. Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-58cf18e8-ea85-4fca-b2b3-577889a69a04 tempest-ProjectReaderTests-866179016 None] Lock "cinder-821c2fc1-bd43-4f0b-926b-7a2644e30875-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-d36a9d04-05e9-49b1-ba50-585a04eb613d-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Lock "cinder-d36a9d04-05e9-49b1-ba50-585a04eb613d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Acquiring lock "cinder-quobyte-d36a9d04-05e9-49b1-ba50-585a04eb613d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Creating offline snapshot cc297421-3590-428e-8bad-97ac64cb79d4 of volume 02f56de0-19b3-4aa6-b2f1-baf890fc961a {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-d36a9d04-05e9-49b1-ba50-585a04eb613d" acquired by "delete_volume" :: waited 0.030s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8bd7e2-2d93-410d-804b-c59c544b3981]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb766d7-a13e-4a6d-ab12-3187c7de1861]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:35 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:35 devstack sudo[109577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a Jul 24 12:59:35 devstack sudo[109577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:35 devstack sudo[109578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d Jul 24 12:59:35 devstack sudo[109578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:36 devstack sudo[109577]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a" returned: 0 in 0.408s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:36 devstack sudo[109578]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d" returned: 0 in 0.411s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:36 devstack sudo[109588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 1G Jul 24 12:59:36 devstack sudo[109588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:36 devstack sudo[109589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d Jul 24 12:59:36 devstack sudo[109589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:36 devstack sudo[109589]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d36a9d04-05e9-49b1-ba50-585a04eb613d" returned: 0 in 0.259s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Lock "cinder-quobyte-d36a9d04-05e9-49b1-ba50-585a04eb613d" released by "delete_volume" :: held 0.746s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Created reservations ['84d5737c-b0b7-4829-92e4-b02fb5b96605', '5931079a-39c8-42fa-bb8f-7b51256e3e73', 'b2c807ae-4da9-4890-91e4-a6886ce5bc30', 'd14a3dfa-5846-4f11-81f7-c7977b470089'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:36 devstack sudo[109588]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 1G" returned: 0 in 0.464s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:36 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:36 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:36 devstack sudo[109599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 Jul 24 12:59:36 devstack sudo[109599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:36 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.304s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:36 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Deleted volume successfully. Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b0fc5933-c4e8-4a0d-9d2d-e36cd46792b8 tempest-ProjectReaderTests-866179016 None] Lock "cinder-d36a9d04-05e9-49b1-ba50-585a04eb613d-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:36 devstack sudo[109599]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4" returned: 0 in 0.359s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:36 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 is being set with open permissions: ugo+rw Jul 24 12:59:36 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:36 devstack sudo[109606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 Jul 24 12:59:36 devstack sudo[109606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:37 devstack sudo[109606]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4" returned: 0 in 0.278s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:37 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.info Jul 24 12:59:37 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:37 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.info" returned: 0 in 0.270s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:37 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.info is being set with open permissions: ugo+rw Jul 24 12:59:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:37 devstack sudo[109612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.info Jul 24 12:59:37 devstack sudo[109612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:37 devstack sudo[109612]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.info" returned: 0 in 0.301s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:37 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.221s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:37 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ee9344a6-fa50-4bae-86a2-8b15170202f7 tempest-ProjectMemberTests-2053079969 None] Create snapshot completed successfully Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-cc297421-3590-428e-8bad-97ac64cb79d4-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-cc297421-3590-428e-8bad-97ac64cb79d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-02f56de0-19b3-4aa6-b2f1-baf890fc961a" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-02f56de0-19b3-4aa6-b2f1-baf890fc961a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-cc297421-3590-428e-8bad-97ac64cb79d4" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-cc297421-3590-428e-8bad-97ac64cb79d4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Deleting offline snapshot cc297421-3590-428e-8bad-97ac64cb79d4 of volume 02f56de0-19b3-4aa6-b2f1-baf890fc961a {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] snapshot_file for this snap is: volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3319eb4-0364-4576-9b0b-620782acf803]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:38 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:39 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 Jul 24 12:59:39 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:39 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4" returned: 0 in 0.452s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:39 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:39 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb0448b-559c-495c-b685-86993a707142]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:39 devstack sudo[109624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a Jul 24 12:59:39 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:39 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a" returned: 0 in 0.497s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:39 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:40 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 Jul 24 12:59:40 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:40 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4" returned: 0 in 0.476s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:40 devstack sudo[109636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4 Jul 24 12:59:40 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:40 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:40 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a.cc297421-3590-428e-8bad-97ac64cb79d4" returned: 0 in 0.280s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-cc297421-3590-428e-8bad-97ac64cb79d4" released by "_delete_snapshot" :: held 1.844s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-02f56de0-19b3-4aa6-b2f1-baf890fc961a" released by "delete_snapshot" :: held 1.876s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:40 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Created reservations ['427ccc8c-fd7d-42a2-9654-a7a37ca7a6af', '15fdd05c-a20b-4aa0-8e2e-56111ca85573', 'd8aa9362-2fc4-4332-8866-6f6076033763', '6d610141-8743-4904-bbea-cc9f9599aa6d'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:40 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Delete snapshot completed successfully. Jul 24 12:59:40 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e73b1d9d-b1cb-4942-9279-fcf55a920233 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-cc297421-3590-428e-8bad-97ac64cb79d4-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-02f56de0-19b3-4aa6-b2f1-baf890fc961a-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-02f56de0-19b3-4aa6-b2f1-baf890fc961a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-02f56de0-19b3-4aa6-b2f1-baf890fc961a" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-02f56de0-19b3-4aa6-b2f1-baf890fc961a" acquired by "delete_volume" :: waited 0.012s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9977e7b-8986-4b57-a1a3-7131e2f954d3]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:41 devstack sudo[109639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a Jul 24 12:59:41 devstack sudo[109639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:41 devstack sudo[109639]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a" returned: 0 in 0.370s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:41 devstack sudo[109644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a Jul 24 12:59:41 devstack sudo[109644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:41 devstack sudo[109644]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-02f56de0-19b3-4aa6-b2f1-baf890fc961a" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-02f56de0-19b3-4aa6-b2f1-baf890fc961a" released by "delete_volume" :: held 0.702s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Created reservations ['c77d7a43-6b45-48b6-b500-def3931a2fb8', '64977c23-cce3-40ba-b8e4-ad57a677b6f1', 'dbb2bfce-de7e-42bd-a755-aaf784ba7c47', '0b569192-5158-41d6-b763-fb102d3b5f77'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:41 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:41 devstack sudo[109647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:41 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:42 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.284s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:42 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Deleted volume successfully. Jul 24 12:59:42 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:42 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-c06f118c-9eab-4543-be06-3513df72c979 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-02f56de0-19b3-4aa6-b2f1-baf890fc961a-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:42 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.289s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (1cfbf98f-1589-4814-8da1-1d8dec3d618a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c22d46-20ca-4aa4-afcf-12b9362c16ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54c22d46-20ca-4aa4-afcf-12b9362c16ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814213063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b319ff11-064c-4e7a-9379-cb63ab6533de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:43Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ce63be-cc7b-4565-9f01-aa0fea51ba7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ce63be-cc7b-4565-9f01-aa0fea51ba7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb82f34-4eac-4717-98c1-cc4b86c21ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb82f34-4eac-4717-98c1-cc4b86c21ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b319ff11-064c-4e7a-9379-cb63ab6533de', 'volume_name': 'volume-b319ff11-064c-4e7a-9379-cb63ab6533de', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc566c63-240d-423b-80bc-0056fe7df68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc566c63-240d-423b-80bc-0056fe7df68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f420495-eec5-4abc-9e60-bdac5133ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:42 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Volume b319ff11-064c-4e7a-9379-cb63ab6533de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b319ff11-064c-4e7a-9379-cb63ab6533de', 'volume_size': 1} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814213063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b319ff11-064c-4e7a-9379-cb63ab6533de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:43Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Creating volume b319ff11-064c-4e7a-9379-cb63ab6533de {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:42 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:42 devstack sudo[109653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de 1073741824 Jul 24 12:59:42 devstack sudo[109653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:43 devstack sudo[109653]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de 1073741824" returned: 0 in 0.406s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:43 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de Jul 24 12:59:43 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:43 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de" returned: 0 in 0.244s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:43 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:43 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f420495-eec5-4abc-9e60-bdac5133ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b319ff11-064c-4e7a-9379-cb63ab6533de', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a119ee-f07f-474f-94f8-6f0630b8a104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:43 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Volume volume-b319ff11-064c-4e7a-9379-cb63ab6533de (b319ff11-064c-4e7a-9379-cb63ab6533de): created successfully Jul 24 12:59:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a119ee-f07f-474f-94f8-6f0630b8a104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:43 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (1cfbf98f-1589-4814-8da1-1d8dec3d618a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:43 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fe7c14b3-9d3b-4fa2-b405-373e5dad2b9e tempest-ProjectMemberTests-2053079969 None] Created volume successfully. Jul 24 12:59:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:44 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Creating offline snapshot 35416f28-551b-4967-a3f8-25197362ef5f of volume b319ff11-064c-4e7a-9379-cb63ab6533de {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:44 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4e1a2f-b209-41bb-ac24-20ef5b4939a0]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:44 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:45 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de Jul 24 12:59:45 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:45 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de" returned: 0 in 0.361s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:45 devstack sudo[109667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f 1G Jul 24 12:59:45 devstack sudo[109667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:45 devstack sudo[109667]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f 1G" returned: 0 in 0.414s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:45 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b319ff11-064c-4e7a-9379-cb63ab6533de -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:45 devstack sudo[109673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b319ff11-064c-4e7a-9379-cb63ab6533de -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f Jul 24 12:59:45 devstack sudo[109673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:46 devstack sudo[109673]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b319ff11-064c-4e7a-9379-cb63ab6533de -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f" returned: 0 in 0.313s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:46 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f is being set with open permissions: ugo+rw Jul 24 12:59:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:46 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f Jul 24 12:59:46 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:46 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f" returned: 0 in 0.256s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:46 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.info Jul 24 12:59:46 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:46 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.info" returned: 0 in 0.265s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:46 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.info is being set with open permissions: ugo+rw Jul 24 12:59:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:46 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.info Jul 24 12:59:46 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:46 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.info" returned: 0 in 0.282s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:46 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:46 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-4aad78e9-35a1-44f2-aefe-04af5d083723 tempest-ProjectMemberTests-2053079969 None] Create snapshot completed successfully Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-35416f28-551b-4967-a3f8-25197362ef5f-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-35416f28-551b-4967-a3f8-25197362ef5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-b319ff11-064c-4e7a-9379-cb63ab6533de" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-b319ff11-064c-4e7a-9379-cb63ab6533de" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-35416f28-551b-4967-a3f8-25197362ef5f" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-35416f28-551b-4967-a3f8-25197362ef5f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Deleting offline snapshot 35416f28-551b-4967-a3f8-25197362ef5f of volume b319ff11-064c-4e7a-9379-cb63ab6533de {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] snapshot_file for this snap is: volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b654b5-4592-4c36-9842-4c4049cf6a2e]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:47 devstack sudo[109687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f Jul 24 12:59:47 devstack sudo[109687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:47 devstack sudo[109687]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f" returned: 0 in 0.371s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b319ff11-064c-4e7a-9379-cb63ab6533de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab5212a-baee-4c08-b738-3420ea2a168d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:47 devstack sudo[109693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de Jul 24 12:59:47 devstack sudo[109693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:47 devstack sudo[109693]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de" returned: 0 in 0.355s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:47 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:47 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f Jul 24 12:59:47 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:48 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f" returned: 0 in 0.341s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:48 devstack sudo[109703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f Jul 24 12:59:48 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:48 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:48 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de.35416f28-551b-4967-a3f8-25197362ef5f" returned: 0 in 0.244s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-35416f28-551b-4967-a3f8-25197362ef5f" released by "_delete_snapshot" :: held 1.404s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-b319ff11-064c-4e7a-9379-cb63ab6533de" released by "delete_snapshot" :: held 1.425s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:48 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Created reservations ['90155002-f508-48e5-b269-d1fb39ecb4c5', '306628dc-03a8-44f7-a386-c09a2a19b4d0', '6665099c-156e-4451-bece-98c21e3b73a2', 'ec181682-935c-480f-9c86-f1afe39e80af'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:48 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Delete snapshot completed successfully. Jul 24 12:59:48 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5cfeb332-5d27-4022-a0b2-6053f4db410d tempest-ProjectMemberTests-2053079969 None] Lock "cinder-35416f28-551b-4967-a3f8-25197362ef5f-delete_snapshot" released by "delete_snapshot" :: held 1.571s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-b319ff11-064c-4e7a-9379-cb63ab6533de-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-b319ff11-064c-4e7a-9379-cb63ab6533de-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-b319ff11-064c-4e7a-9379-cb63ab6533de" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-b319ff11-064c-4e7a-9379-cb63ab6533de" acquired by "delete_volume" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5f0325-7496-4e87-974d-bbdb5f02675d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:49 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de Jul 24 12:59:49 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:49 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de" returned: 0 in 0.349s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:49 devstack sudo[109712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de Jul 24 12:59:49 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:49 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-b319ff11-064c-4e7a-9379-cb63ab6533de" returned: 0 in 0.251s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-b319ff11-064c-4e7a-9379-cb63ab6533de" released by "delete_volume" :: held 0.660s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:DELETE=18,cinder:SELECT=179,cinder:INSERT=55,cinder:UPDATE=213 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:59:49 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:UPDATE=211,cinder:SELECT=163,cinder:INSERT=62,cinder:DELETE=17 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Created reservations ['2046f5f3-0377-4c9f-a2e4-c0d103e93b18', 'f70a77e7-a58c-44be-9964-4de69734aa55', '7992e8b8-8dfd-4d71-affb-aff89290be6d', 'df5839d2-0630-486a-aaa2-591f3ba91a63'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:50 devstack sudo[109715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:50 devstack sudo[109715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:50 devstack sudo[109715]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.253s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:50 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Deleted volume successfully. Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-8bd78aa6-b653-4519-b8bd-7be0adafbef7 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-b319ff11-064c-4e7a-9379-cb63ab6533de-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:50 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (3deb997e-a586-4a72-b5bc-cc0fcc8264b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada45dfe-7823-4eb8-a191-4ace6030aced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada45dfe-7823-4eb8-a191-4ace6030aced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449065766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ad1683-36f5-4ac8-b378-30cf8f97ffc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:51Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7fde3e-507a-43dc-9b05-ea2065dcf370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd7fde3e-507a-43dc-9b05-ea2065dcf370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dbe36f-39bb-412a-996b-27b57704e809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dbe36f-39bb-412a-996b-27b57704e809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ad1683-36f5-4ac8-b378-30cf8f97ffc7', 'volume_name': 'volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cc5c0f-ccbf-4a6e-b6b1-ca4d3ca01de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32cc5c0f-ccbf-4a6e-b6b1-ca4d3ca01de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95167c2-3f29-4060-ba27-90d3ac959d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:51 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Volume 19ad1683-36f5-4ac8-b378-30cf8f97ffc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7', 'volume_size': 1} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449065766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19ad1683-36f5-4ac8-b378-30cf8f97ffc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:51Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Creating volume 19ad1683-36f5-4ac8-b378-30cf8f97ffc7 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:51 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:51 devstack sudo[109718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 1073741824 Jul 24 12:59:51 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:51 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 1073741824" returned: 0 in 0.405s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:51 devstack sudo[109724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 Jul 24 12:59:51 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:51 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" returned: 0 in 0.248s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c95167c2-3f29-4060-ba27-90d3ac959d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e0f5cf-3b86-478a-92db-ff6924fd430d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:51 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Volume volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 (19ad1683-36f5-4ac8-b378-30cf8f97ffc7): created successfully Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e0f5cf-3b86-478a-92db-ff6924fd430d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:51 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (3deb997e-a586-4a72-b5bc-cc0fcc8264b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:51 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-df011b49-489f-4674-9062-b34ee50c7dd5 tempest-ProjectMemberTests-2053079969 None] Created volume successfully. Jul 24 12:59:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:53 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Creating offline snapshot 6a41bc44-b200-41a5-af0a-50a24b048cb7 of volume 19ad1683-36f5-4ac8-b378-30cf8f97ffc7 {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 12:59:53 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e4b2f1-fb32-445d-8d68-b0508c5bbfe5]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:53 devstack sudo[109727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 Jul 24 12:59:53 devstack sudo[109727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:53 devstack sudo[109727]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" returned: 0 in 0.369s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:53 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 1G Jul 24 12:59:53 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:53 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 1G" returned: 0 in 0.433s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:53 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:53 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 Jul 24 12:59:53 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:54 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7" returned: 0 in 0.290s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:54 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 is being set with open permissions: ugo+rw Jul 24 12:59:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:54 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 Jul 24 12:59:54 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:54 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7" returned: 0 in 0.246s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:54 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.info Jul 24 12:59:54 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:54 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.info" returned: 0 in 0.246s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:54 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.info is being set with open permissions: ugo+rw Jul 24 12:59:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:54 devstack sudo[109749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.info Jul 24 12:59:54 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:54 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.info" returned: 0 in 0.252s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:54 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.926s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:55 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-0fe69ebc-e3c8-46ff-a56c-72b75091628f tempest-ProjectMemberTests-2053079969 None] Create snapshot completed successfully Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-6a41bc44-b200-41a5-af0a-50a24b048cb7-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Lock "cinder-6a41bc44-b200-41a5-af0a-50a24b048cb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-6a41bc44-b200-41a5-af0a-50a24b048cb7" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-6a41bc44-b200-41a5-af0a-50a24b048cb7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Deleting offline snapshot 6a41bc44-b200-41a5-af0a-50a24b048cb7 of volume 19ad1683-36f5-4ac8-b378-30cf8f97ffc7 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] snapshot_file for this snap is: volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[b662f1eb-fddf-4ba8-9e6b-ebbd328a4349]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:55 devstack sudo[109752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 Jul 24 12:59:55 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:55 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7" returned: 0 in 0.399s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[58700b1c-895f-4b79-831b-ef02b962acb8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:55 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:55 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 Jul 24 12:59:55 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:56 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" returned: 0 in 0.361s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:56 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 Jul 24 12:59:56 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:56 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7" returned: 0 in 0.349s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:56 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7 Jul 24 12:59:56 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:56 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:56 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7.6a41bc44-b200-41a5-af0a-50a24b048cb7" returned: 0 in 0.256s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-6a41bc44-b200-41a5-af0a-50a24b048cb7" released by "_delete_snapshot" :: held 1.475s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" released by "delete_snapshot" :: held 1.496s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:56 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Created reservations ['1c4e396c-dd4f-4974-8c52-b62c1f4219a8', '5652791d-6ef3-4328-b609-68c17d54b0d0', 'e0128729-96ff-4b44-a076-0eac2892f3a7', 'd1ec35fb-14a7-47ac-bff9-5c83ecc6b9df'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:56 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Delete snapshot completed successfully. Jul 24 12:59:56 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-e4a9354b-1017-4760-9b89-d5f58f9ecd5c tempest-ProjectMemberTests-2053079969 None] Lock "cinder-6a41bc44-b200-41a5-af0a-50a24b048cb7-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-19ad1683-36f5-4ac8-b378-30cf8f97ffc7-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Lock "cinder-19ad1683-36f5-4ac8-b378-30cf8f97ffc7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 12:59:57 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" acquired by "delete_volume" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 12:59:57 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398252c-012d-42c9-8a75-ffa399cbaa7f]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 12:59:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:57 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 Jul 24 12:59:57 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:57 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" returned: 0 in 0.382s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:57 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:57 devstack sudo[109813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7 Jul 24 12:59:57 devstack sudo[109813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:58 devstack sudo[109813]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" returned: 0 in 0.252s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-19ad1683-36f5-4ac8-b378-30cf8f97ffc7" released by "delete_volume" :: held 0.693s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Created reservations ['8e76ed3a-beb7-43f4-a69f-d10d95eabc59', 'a67ac0bc-c7ae-4b16-ac0f-2f2d492583ce', '62834806-49b8-4af1-b81e-3b59bf9c6f15', '6443bb0d-e01f-4723-a322-562534675e67'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:58 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 12:59:58 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:58 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.247s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 12:59:58 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Deleted volume successfully. Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-87d8ffed-016f-4753-b175-3b1ea26be08a tempest-ProjectMemberTests-2053079969 None] Lock "cinder-19ad1683-36f5-4ac8-b378-30cf8f97ffc7-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (64f5cd4d-b0ca-46dc-9fbb-f8e0f8fd0f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9403b92-1770-4c73-a1c1-a55645fd776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9403b92-1770-4c73-a1c1-a55645fd776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561148532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c7c16f-e140-4251-ac85-86e1a467021c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:59Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe76a5a6-fcfa-4b02-b798-c76bff937c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe76a5a6-fcfa-4b02-b798-c76bff937c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2aa36a1-082d-4192-8ed1-4cce30bbac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2aa36a1-082d-4192-8ed1-4cce30bbac9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c7c16f-e140-4251-ac85-86e1a467021c', 'volume_name': 'volume-00c7c16f-e140-4251-ac85-86e1a467021c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b672a61-3bb0-46ed-83a4-76da4b22a26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:58 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b672a61-3bb0-46ed-83a4-76da4b22a26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a926c2c3-0d6b-480e-b6e3-fd85ef675f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:59 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Volume 00c7c16f-e140-4251-ac85-86e1a467021c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c7c16f-e140-4251-ac85-86e1a467021c', 'volume_size': 1} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T10:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-561148532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c7c16f-e140-4251-ac85-86e1a467021c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T10:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T10:59:59Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Creating volume 00c7c16f-e140-4251-ac85-86e1a467021c {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 12:59:59 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:59 devstack sudo[109819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c 1073741824 Jul 24 12:59:59 devstack sudo[109819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:59 devstack sudo[109819]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c 1073741824" returned: 0 in 0.391s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 12:59:59 devstack sudo[109826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c Jul 24 12:59:59 devstack sudo[109826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 12:59:59 devstack sudo[109826]: pam_unix(sudo:session): session closed for user root Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c" returned: 0 in 0.240s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a926c2c3-0d6b-480e-b6e3-fd85ef675f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c7c16f-e140-4251-ac85-86e1a467021c', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1dc138-8f2a-41ea-a4d3-8cf9b84713c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 12:59:59 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Volume volume-00c7c16f-e140-4251-ac85-86e1a467021c (00c7c16f-e140-4251-ac85-86e1a467021c): created successfully Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1dc138-8f2a-41ea-a4d3-8cf9b84713c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 12:59:59 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (64f5cd4d-b0ca-46dc-9fbb-f8e0f8fd0f57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 12:59:59 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-e2f7df5a-dc07-4b17-a8ce-058c4d22ecff tempest-ProjectMemberTests-2053079969 None] Created volume successfully. Jul 24 13:00:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:00 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Creating offline snapshot 72d0df25-807f-4702-a1e1-717ec3de51d6 of volume 00c7c16f-e140-4251-ac85-86e1a467021c {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 13:00:00 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[da447857-14d5-4685-a9b4-3df09b7de8d8]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:00 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c Jul 24 13:00:00 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:00 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c" returned: 0 in 0.346s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:00 devstack sudo[109834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 1G Jul 24 13:00:00 devstack sudo[109834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:00 devstack sudo[109834]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 1G" returned: 0 in 0.380s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:00 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c7c16f-e140-4251-ac85-86e1a467021c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:00 devstack sudo[109839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c7c16f-e140-4251-ac85-86e1a467021c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 Jul 24 13:00:00 devstack sudo[109839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:01 devstack sudo[109839]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c7c16f-e140-4251-ac85-86e1a467021c -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6" returned: 0 in 0.292s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:01 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 is being set with open permissions: ugo+rw Jul 24 13:00:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:01 devstack sudo[109844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 Jul 24 13:00:01 devstack sudo[109844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:01 devstack sudo[109844]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6" returned: 0 in 0.236s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:01 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.info Jul 24 13:00:01 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:01 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.info" returned: 0 in 0.250s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:01 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.info is being set with open permissions: ugo+rw Jul 24 13:00:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:01 devstack sudo[109850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.info Jul 24 13:00:01 devstack sudo[109850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:01 devstack sudo[109850]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.info" returned: 0 in 0.236s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:01 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:01 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-347a7db4-82e5-46f6-9661-d543b0d35e9c tempest-ProjectMemberTests-2053079969 None] Create snapshot completed successfully Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-72d0df25-807f-4702-a1e1-717ec3de51d6-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Lock "cinder-72d0df25-807f-4702-a1e1-717ec3de51d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-00c7c16f-e140-4251-ac85-86e1a467021c" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-00c7c16f-e140-4251-ac85-86e1a467021c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-72d0df25-807f-4702-a1e1-717ec3de51d6" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-72d0df25-807f-4702-a1e1-717ec3de51d6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Deleting offline snapshot 72d0df25-807f-4702-a1e1-717ec3de51d6 of volume 00c7c16f-e140-4251-ac85-86e1a467021c {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] snapshot_file for this snap is: volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[916b873a-6e1f-4c7f-8973-03dbe803e1d9]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:02 devstack sudo[109853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 Jul 24 13:00:02 devstack sudo[109853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:02 devstack sudo[109853]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6" returned: 0 in 0.345s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00c7c16f-e140-4251-ac85-86e1a467021c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5c4971-bdf4-4f4d-bfef-ce0447de2112]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:02 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:02 devstack sudo[109858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c Jul 24 13:00:02 devstack sudo[109858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:03 devstack sudo[109858]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c" returned: 0 in 0.375s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:03 devstack sudo[109864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 Jul 24 13:00:03 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:03 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6" returned: 0 in 0.327s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:03 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6 Jul 24 13:00:03 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:03 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:03 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c.72d0df25-807f-4702-a1e1-717ec3de51d6" returned: 0 in 0.236s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-72d0df25-807f-4702-a1e1-717ec3de51d6" released by "_delete_snapshot" :: held 1.383s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-00c7c16f-e140-4251-ac85-86e1a467021c" released by "delete_snapshot" :: held 1.406s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:03 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Created reservations ['cbbae9bc-7705-4b2f-86c1-0a2eccdab153', '2f5c5646-8c2b-486d-a794-76981dcc6b48', '14bc40c2-d980-48aa-97bd-724631d62aea', '55ca5bff-95f6-4df2-88d4-0e4fe22051d8'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 13:00:03 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Delete snapshot completed successfully. Jul 24 13:00:03 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-b36de8cd-4d1b-4490-a141-924435831f1e tempest-ProjectMemberTests-2053079969 None] Lock "cinder-72d0df25-807f-4702-a1e1-717ec3de51d6-delete_snapshot" released by "delete_snapshot" :: held 1.530s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-00c7c16f-e140-4251-ac85-86e1a467021c-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-00c7c16f-e140-4251-ac85-86e1a467021c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-00c7c16f-e140-4251-ac85-86e1a467021c" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:04 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-00c7c16f-e140-4251-ac85-86e1a467021c" acquired by "delete_volume" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:04 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4ba0f0-a521-43e2-b17b-0354f9acd647]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:04 devstack sudo[109878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c Jul 24 13:00:04 devstack sudo[109878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:04 devstack sudo[109878]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c" returned: 0 in 0.343s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:04 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:04 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c Jul 24 13:00:04 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:05 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-00c7c16f-e140-4251-ac85-86e1a467021c" returned: 0 in 0.235s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-00c7c16f-e140-4251-ac85-86e1a467021c" released by "delete_volume" :: held 0.632s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Created reservations ['4b75c342-c510-48c6-9cc0-0dc6dce2cf84', '15ea186e-499a-4dee-be31-f89892689d4f', '722939fb-2948-4e53-9313-9f067c85788d', 'c5db6e31-5911-4722-b749-c8f600c53fa5'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:05 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 13:00:05 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:05 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.237s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 13:00:05 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Deleted volume successfully. Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fe58861b-5e2f-4607-a5bf-cf02b0e60da4 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-00c7c16f-e140-4251-ac85-86e1a467021c-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (25bb2625-1317-4c23-8716-1cfc556d29d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fb306d-db81-454e-be33-2714e9c96474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fb306d-db81-454e-be33-2714e9c96474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T11:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858839461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d379509-fc5a-4704-8f46-0b9ea4f9a36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T11:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T11:00:06Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab441cf-0eea-4977-9c37-2c6892e8060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab441cf-0eea-4977-9c37-2c6892e8060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4893b1-7612-4f90-a4fb-48a120c6f6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d4893b1-7612-4f90-a4fb-48a120c6f6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d379509-fc5a-4704-8f46-0b9ea4f9a36d', 'volume_name': 'volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619961cc-40ae-414c-a355-31d12b397e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619961cc-40ae-414c-a355-31d12b397e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5b660d-6452-4412-8b37-54437e4fcfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:05 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Volume 7d379509-fc5a-4704-8f46-0b9ea4f9a36d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d', 'volume_size': 1} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T11:00:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-858839461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d379509-fc5a-4704-8f46-0b9ea4f9a36d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51847ed92abc49b3a3c2a824ef4627e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T11:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T11:00:06Z,use_quota=True,user_id='c165ec53659642cbb4dc091378ce7491',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Creating volume 7d379509-fc5a-4704-8f46-0b9ea4f9a36d {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:05 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 13:00:06 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:06 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d 1073741824 Jul 24 13:00:06 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:06 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d 1073741824" returned: 0 in 0.396s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:06 devstack sudo[109897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d Jul 24 13:00:06 devstack sudo[109897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:06 devstack sudo[109897]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" returned: 0 in 0.242s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a5b660d-6452-4412-8b37-54437e4fcfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eca9185-a07c-4bc3-8917-af2dd4da3574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:06 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Volume volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d (7d379509-fc5a-4704-8f46-0b9ea4f9a36d): created successfully Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eca9185-a07c-4bc3-8917-af2dd4da3574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:06 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Flow 'volume_create_manager' (25bb2625-1317-4c23-8716-1cfc556d29d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 13:00:06 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-343a7b3b-15f6-4f6c-8926-534020efbdb1 tempest-ProjectMemberTests-2053079969 None] Created volume successfully. Jul 24 13:00:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:07 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Creating offline snapshot 96947834-2c6c-4b8b-98bd-57bc620e6d29 of volume 7d379509-fc5a-4704-8f46-0b9ea4f9a36d {{(pid=88540) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 13:00:07 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8000022-e827-490c-aa16-ffca9a0c701d]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:07 devstack sudo[109900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d Jul 24 13:00:07 devstack sudo[109900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:07 devstack sudo[109900]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" returned: 0 in 0.345s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 1G {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:07 devstack sudo[109905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 1G Jul 24 13:00:07 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:07 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 1G" returned: 0 in 0.373s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:07 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:07 devstack sudo[109910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 Jul 24 13:00:07 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:08 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d -F qcow2 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29" returned: 0 in 0.293s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:08 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 is being set with open permissions: ugo+rw Jul 24 13:00:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:08 devstack sudo[109915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 Jul 24 13:00:08 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:08 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29" returned: 0 in 0.237s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:08 devstack sudo[109918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.info Jul 24 13:00:08 devstack sudo[109918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:08 devstack sudo[109918]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.info" returned: 0 in 0.248s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:08 devstack cinder-volume[88540]: WARNING cinder.volume.drivers.remotefs [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.info is being set with open permissions: ugo+rw Jul 24 13:00:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.info {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:08 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.info Jul 24 13:00:08 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:08 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.info" returned: 0 in 0.240s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:08 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:08 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-1aa00f5f-929d-439f-9047-2f74faa0c3a7 tempest-ProjectMemberTests-2053079969 None] Create snapshot completed successfully Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-96947834-2c6c-4b8b-98bd-57bc620e6d29-delete_snapshot" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-96947834-2c6c-4b8b-98bd-57bc620e6d29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" by "delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-96947834-2c6c-4b8b-98bd-57bc620e6d29" by "_delete_snapshot" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-96947834-2c6c-4b8b-98bd-57bc620e6d29" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Deleting offline snapshot 96947834-2c6c-4b8b-98bd-57bc620e6d29 of volume 7d379509-fc5a-4704-8f46-0b9ea4f9a36d {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] snapshot_file for this snap is: volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 {{(pid=88540) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[0822a2e4-09da-4f6c-b5fd-5413bc03af94]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:09 devstack sudo[109925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 Jul 24 13:00:09 devstack sudo[109925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:09 devstack sudo[109925]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29" returned: 0 in 0.349s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88540) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[16545076-4219-407f-840f-c174708a8a70]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:09 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:09 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d Jul 24 13:00:09 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:10 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" returned: 0 in 0.343s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:10 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 Jul 24 13:00:10 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:10 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29" returned: 0 in 0.332s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:10 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29 Jul 24 13:00:10 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:10 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:10 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d.96947834-2c6c-4b8b-98bd-57bc620e6d29" returned: 0 in 0.234s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-96947834-2c6c-4b8b-98bd-57bc620e6d29" released by "_delete_snapshot" :: held 1.343s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" released by "delete_snapshot" :: held 1.364s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:10 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Created reservations ['fe49f95e-b581-4284-9e9d-e0f4f8e55891', '3d9885d7-bb14-4a12-948b-db7d9c1bf38c', '39e8d6c1-e186-4e6d-8837-3dc5ddf75dba', '88f12fba-0914-40fa-b596-0394e8dae4a0'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 13:00:10 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Delete snapshot completed successfully. Jul 24 13:00:10 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-ef969d6a-6f78-4e8d-8b9f-795e0738f512 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-96947834-2c6c-4b8b-98bd-57bc620e6d29-delete_snapshot" released by "delete_snapshot" :: held 1.493s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-7d379509-fc5a-4704-8f46-0b9ea4f9a36d-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-7d379509-fc5a-4704-8f46-0b9ea4f9a36d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "cinder-quobyte-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:11 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" acquired by "delete_volume" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:11 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5621766-8939-4327-9fbd-ab206db82681]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:11 devstack sudo[109944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d Jul 24 13:00:11 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:11 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" returned: 0 in 0.348s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:11 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:11 devstack sudo[109949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d Jul 24 13:00:11 devstack sudo[109949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:12 devstack sudo[109949]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" returned: 0 in 0.242s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-quobyte-7d379509-fc5a-4704-8f46-0b9ea4f9a36d" released by "delete_volume" :: held 0.645s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Created reservations ['b9824904-2bbf-4faf-876c-0c057b2ae9ac', 'eb1823c7-e621-4741-8b4a-fc49320a6127', '32454720-2028-4221-8ea8-4a12844ec6ae', '090e6287-d33f-4552-9cd5-b287d36335a4'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:12 devstack sudo[109952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 13:00:12 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:12 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.240s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 13:00:12 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Deleted volume successfully. Jul 24 13:00:12 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-075aaf3a-d2da-49c8-9047-8974662e5f62 tempest-ProjectMemberTests-2053079969 None] Lock "cinder-7d379509-fc5a-4704-8f46-0b9ea4f9a36d-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Flow 'volume_create_manager' (90d92645-d8f4-43fb-aec9-cc7e4ada295d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4710c6a-e075-46f3-b48a-d9192bcbb407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4710c6a-e075-46f3-b48a-d9192bcbb407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T11:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447265132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f35f10-ed73-4404-a09d-1c0e0927df40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4e741860de46e2b04a1a9422172e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T11:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T11:00:16Z,use_quota=True,user_id='d624fee147fb4624be3d8a2b5655d6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd49bbe-a222-4494-b346-011c35c13f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd49bbe-a222-4494-b346-011c35c13f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fd0bbb-86b9-417e-ad3a-3f9361cbd576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fd0bbb-86b9-417e-ad3a-3f9361cbd576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f35f10-ed73-4404-a09d-1c0e0927df40', 'volume_name': 'volume-48f35f10-ed73-4404-a09d-1c0e0927df40', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0c27cd-2fd8-4b6a-a745-37ff5bddc579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0c27cd-2fd8-4b6a-a745-37ff5bddc579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf53403-fd1c-49ee-94e0-f785634126ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:16 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Volume 48f35f10-ed73-4404-a09d-1c0e0927df40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f35f10-ed73-4404-a09d-1c0e0927df40', 'volume_size': 1} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T11:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-447265132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f35f10-ed73-4404-a09d-1c0e0927df40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4e741860de46e2b04a1a9422172e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T11:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T11:00:16Z,use_quota=True,user_id='d624fee147fb4624be3d8a2b5655d6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Creating volume 48f35f10-ed73-4404-a09d-1c0e0927df40 {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 13:00:16 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:16 devstack sudo[109955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40 1073741824 Jul 24 13:00:16 devstack sudo[109955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:16 devstack sudo[109955]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40 1073741824" returned: 0 in 0.392s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:16 devstack sudo[109961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40 Jul 24 13:00:16 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:16 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40" returned: 0 in 0.239s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf53403-fd1c-49ee-94e0-f785634126ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f35f10-ed73-4404-a09d-1c0e0927df40', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d888c7-0e3f-4f9e-80ce-7189fc9dab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:16 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Volume volume-48f35f10-ed73-4404-a09d-1c0e0927df40 (48f35f10-ed73-4404-a09d-1c0e0927df40): created successfully Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86d888c7-0e3f-4f9e-80ce-7189fc9dab97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:16 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Flow 'volume_create_manager' (90d92645-d8f4-43fb-aec9-cc7e4ada295d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 13:00:16 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-99d7e381-30ba-4cca-818a-f046a50b756c tempest-ProjectReaderTests-1196375050 None] Created volume successfully. Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Acquiring lock "cinder-48f35f10-ed73-4404-a09d-1c0e0927df40-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Lock "cinder-48f35f10-ed73-4404-a09d-1c0e0927df40-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Acquiring lock "cinder-quobyte-48f35f10-ed73-4404-a09d-1c0e0927df40" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Lock "cinder-quobyte-48f35f10-ed73-4404-a09d-1c0e0927df40" acquired by "delete_volume" :: waited 0.016s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeab3b1-b64a-43ae-8ee4-fcf876d59312]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:17 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40 Jul 24 13:00:17 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:17 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40" returned: 0 in 0.342s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:17 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40 Jul 24 13:00:17 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:17 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-48f35f10-ed73-4404-a09d-1c0e0927df40" returned: 0 in 0.250s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:17 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Lock "cinder-quobyte-48f35f10-ed73-4404-a09d-1c0e0927df40" released by "delete_volume" :: held 0.629s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Created reservations ['55eb4e81-9744-4577-9f2b-ab75019df6c1', 'f07401e5-188a-4cfe-8eb2-2b1cddc51b01', 'd8e0fab3-5951-432d-9823-312351b384ba', '792d892e-a517-4d05-81ff-d24c7ab6c128'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:18 devstack sudo[109972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 13:00:18 devstack sudo[109972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:18 devstack sudo[109972]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.239s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 13:00:18 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Deleted volume successfully. Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-5fa1c6ac-06c3-4c7e-b86b-06d49fa5d24d tempest-ProjectReaderTests-1196375050 None] Lock "cinder-48f35f10-ed73-4404-a09d-1c0e0927df40-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.flows.manager.create_volume [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88540) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Flow 'volume_create_manager' (a6123d98-098e-48fb-bfb3-bd289aa4af01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30426d58-6089-45f6-95c1-a9af761f2ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30426d58-6089-45f6-95c1-a9af761f2ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T11:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844524328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d664e80a-81de-46fc-86ba-9fdd8cc1708d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4e741860de46e2b04a1a9422172e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T11:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T11:00:19Z,use_quota=True,user_id='d624fee147fb4624be3d8a2b5655d6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6faeb90-a51b-40c3-a19a-ce4ec120251f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6faeb90-a51b-40c3-a19a-ce4ec120251f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e7509a-6714-489e-adc6-4a942fa5b02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3e7509a-6714-489e-adc6-4a942fa5b02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd664e80a-81de-46fc-86ba-9fdd8cc1708d', 'volume_name': 'volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40946299-ae1a-4c9b-b6ea-010b61ee4d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40946299-ae1a-4c9b-b6ea-010b61ee4d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508a04cd-a224-44e1-999d-9289d9b1eae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:18 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Volume d664e80a-81de-46fc-86ba-9fdd8cc1708d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d', 'volume_size': 1} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T11:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-844524328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d664e80a-81de-46fc-86ba-9fdd8cc1708d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa4e741860de46e2b04a1a9422172e27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T11:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T11:00:19Z,use_quota=True,user_id='d624fee147fb4624be3d8a2b5655d6c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f780a45f-181b-46e7-b78d-f536c08ecdb8),volume_type_id=f780a45f-181b-46e7-b78d-f536c08ecdb8)}" {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.remotefs [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Creating volume d664e80a-81de-46fc-86ba-9fdd8cc1708d {{(pid=88540) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Selected osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 as target Quobyte volume. {{(pid=88540) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 13:00:18 devstack cinder-volume[88540]: INFO cinder.volume.drivers.remotefs [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] casted to osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4 Jul 24 13:00:18 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d 1073741824 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:18 devstack sudo[109975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d 1073741824 Jul 24 13:00:18 devstack sudo[109975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:19 devstack sudo[109975]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d 1073741824" returned: 0 in 0.399s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:19 devstack sudo[109982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d Jul 24 13:00:19 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:19 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d" returned: 0 in 0.236s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'} {{(pid=88540) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (508a04cd-a224-44e1-999d-9289d9b1eae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d', 'volume_size': 1}' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3782cd-2d1f-4c64-855b-aa7bc5ed5aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 13:00:19 devstack cinder-volume[88540]: INFO cinder.volume.flows.manager.create_volume [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Volume volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d (d664e80a-81de-46fc-86ba-9fdd8cc1708d): created successfully Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b3782cd-2d1f-4c64-855b-aa7bc5ed5aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88540) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Flow 'volume_create_manager' (a6123d98-098e-48fb-bfb3-bd289aa4af01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88540) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 13:00:19 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-850b3613-05d7-4904-be21-d7aa4b8023bd tempest-ProjectReaderTests-1196375050 None] Created volume successfully. Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Acquiring lock "cinder-d664e80a-81de-46fc-86ba-9fdd8cc1708d-delete_volume" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Lock "cinder-d664e80a-81de-46fc-86ba-9fdd8cc1708d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Acquiring lock "cinder-quobyte-d664e80a-81de-46fc-86ba-9fdd8cc1708d" by "delete_volume" {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Lock "cinder-quobyte-d664e80a-81de-46fc-86ba-9fdd8cc1708d" acquired by "delete_volume" :: waited 0.017s {{(pid=88540) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1b1853-5120-455a-b67f-36aa8e1e6966]: (4, 'qcow2') {{(pid=89605) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 13:00:19 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:20 devstack sudo[109985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d Jul 24 13:00:20 devstack sudo[109985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:20 devstack sudo[109985]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d" returned: 0 in 0.345s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:20 devstack sudo[109990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d Jul 24 13:00:20 devstack sudo[109990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:20 devstack sudo[109990]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892/volume-d664e80a-81de-46fc-86ba-9fdd8cc1708d" returned: 0 in 0.247s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Lock "cinder-quobyte-d664e80a-81de-46fc-86ba-9fdd8cc1708d" released by "delete_volume" :: held 0.628s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG cinder.quota [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Created reservations ['97862242-b95d-4736-a264-911419717de8', 'ba21945f-d733-46c7-ae76-f521f0c2a282', '62ca83b7-2c3d-4542-84f2-c6241664aacf', '3138bca0-8c74-4921-aac3-7fd249dd30a9'] {{(pid=88540) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:20 devstack sudo[109993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 13:00:20 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:20 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.235s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 13:00:20 devstack cinder-volume[88540]: INFO cinder.volume.manager [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Deleted volume successfully. Jul 24 13:00:20 devstack cinder-volume[88540]: DEBUG cinder.coordination [None req-fa2c5b9a-3950-464e-870b-f7d8c9ede7af tempest-ProjectReaderTests-1196375050 None] Lock "cinder-d664e80a-81de-46fc-86ba-9fdd8cc1708d-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=88540) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 13:00:30 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:INSERT=22,cinder:UPDATE=80,cinder:SELECT=57,cinder:DELETE=7 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 13:00:30 devstack cinder-volume[88540]: DEBUG dbcounter [-] [88540] Writing DB stats cinder:SELECT=62,cinder:INSERT=22,cinder:UPDATE=88,cinder:DELETE=7 {{(pid=88540) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4': None} {{(pid=88540) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG cinder.volume.drivers.quobyte [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-10189ae9-ccd9-4972-87ee-c2cef0b0c9c4'] {{(pid=88540) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.lockutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88540) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 13:00:42 devstack sudo[110272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892 Jul 24 13:00:42 devstack sudo[110272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 13:00:42 devstack sudo[110272]: pam_unix(sudo:session): session closed for user root Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG oslo_concurrency.processutils [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5fe0de35d0dd1f9935787dccf5936892" returned: 0 in 0.249s {{(pid=88540) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG cinder.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Notifying Schedulers of capabilities ... {{(pid=88540) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG oslo_service.periodic_task [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] Running periodic task VolumeManager._thread_info {{(pid=88540) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread count: 28 {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 13:00:42 devstack cinder-volume[88540]: DEBUG cinder.volume.manager [None req-67200bad-0423-4a7f-b4af-dcb4e6fc3a51 None None] thread info: [<_MainThread(MainThread, started 128134469841024)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88540) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}